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No one understands your need for database performance and availability better than Dell" and Microsoft®. Microsoft 
SQL Server" running on Dell PowerEdge" servers are part of the foundation for Dell's retail website, providing the 
brains behind a number of our key customer-facing applications. This powerful combination helped to improve our 
application management, disaster recovery and server management, and is expected to increase application 


performance 1.4-times over the previous platform. 


To help you experience the greatest potential of your database environment, Dell offers a complete SQL Server 


solution including servers, storage, systems management, services, and the software itself. 


Visit www.dell.com/sglmag for the complete story on how Dell IT uses SOL Server 2005. 


Dell cannot be responsible for errors in typography or photography. Dell, PowerEdge and the Dell logo are trademarks of Dell Inc. Microsoft and SQL Server are trademarks or registered trademarks of Microsoft Corporation. Other trademarks 
and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell disclaims any proprietary interest in the marks and names of others. © 2006 Dell Inc. All rights reserved. 
Reproduction in any manner whatsoever without the written permission of Dell is strictly forbidden. October 2006. 
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database solutions. Here's how the feature works. InstantDoc 
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—Kimberly L. Tripp 
What’s important to consider in designing a database? For optimal perform 
focus on three factors: indexing, maintenance, and statistics. Here's some advie 
get you started in the planning process. InstantDoc 101925897 | 
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LJ —Romen Rehak 
The Native XML Web Services feature in SQL Server 2005 rel 
dependency on IIS to help you create robust, feature-rich entei 


Script your database schema without buying a third-party tool. Heres a 
Windows console-mode utility that uses SQL Management Objects to 
script tables, stored procedures, views, UDFs, and other schema objects 
within your databases. InstantDoc ID 94510 


Reporting Services Tips and Tricks 


—Andrew Potter 

Decrease report development time and improve consistency by using 

templates, custom assemblies, and these layout and performance tips. 
InstantDoc ID 94507 


Optimizing a Suboptimal Query Plan 


—ltzik Ben-Gan 

Does the SQL Server optimizer always choose the the most efficient 
query plan? Itzik shows you how he produced a lower-cost plan than 
the optimizer. InstantDoc ID 94775 
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Clown Cramming 

—Brian Moran 

Imagine 10,000.clowns inside a VW—Is this an accurate 
metaphor for your approach to getting better 1/0 subsystem 
performance? If a system isn’t equipped to handle the 
workload you're placing on it, simply adding more hardware 
(or a slightly bigger car) probably won't magically solve the 
problem. 
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SQLiOSim 

With SQL Server 2005, it can be tough to create a stress test 
that actually stresses your system. Here’s a tool that can 
generate a load sufficient to overwork almost any system. 
InstantDoc ID 94473 
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DATETIME Calculations, Part 1 

—ltzik Ben-Gan 

This first part of a series about DATETIME challenges 
and calculations focuses on the use of trimming 
techniques to return the date or the time in the format 
you want. 
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INSIDE SQL SERVER ........ 27 
Subtle Changes You Might Have Missed 


—Kalen Delaney 

What you thought you knew about SQL Server behavior 
might have changed in SQL Server 2005. Here’s the 
straight story about three such misconceptions. 
InstantDoc ID 94591 
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—Michael D. Cassens 

Check out DatabaseSpy if you routinely work in 
different database environments and need a multi- 
database design and management tool. 
InstantDoc ID 94548 


Spotlight on SQL Server 5.7 

—Michael K. Campbell 

Spotlight on SQL Server shows you real-time SQL Server 
activity, letting you easily monitor the performance of 
your databases. 
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Our editors share insights from their conversations 
with InterSystems Corporation, GridApp Systems, and 
Network Appliance. 
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* Tighter integration with Microsoft* Visual Studio* .NET 


Altova MapForce 2007, the award-winning data 
integration and Web services implementation tool, 
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З — database, flat file, EDI and/or Web services formats 
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ince its introduction, SQL Server has 

played catch-up with other enterprise- 
level relational database products. Oracle and 
IBMS databases were well established when 
Microsoft and Sybase collaborated on the 
first edition of SQL Server in 1989. 

Knowing that it started the race a few 
steps behind, Microsoft opted to compete 
with the relational-database big boys by 
making the database easier to use and the 
data more accessible. Early SQL Server 
releases provided a Windows-based man- 
agement UI. The SQL Server 6.0 and 6.5 
releases included built-in database replication 
to simplify distribution of data through the 
organization. 

When Microsoft released SOL Server 7.0 
as an enterprise-oriented database, it was the 
first major vendor to offer built-in business 
intelligence (BI) capabilities as part of the 
base relational database product. Microsoft 
continued this trend in SQL Server 2000 
by offering built-in data-mining function- 
ality. SQL Server 2005 continues to expand 
the role of the relational database system by 
adding built-in. application-development 
frameworks such as SQL Server Service 
Broker and SQL Server Reporting Services. 
SQL Servers relational database capabilities 
now rival Oracle and IBM DB2, and fea- 
tures such as Analysis Services, SOL Server 
Integration Services (SSIS), and Reporting 
Services have no parallels in the competing 
database products. 

Many of Microsofts current database 
products are geared toward extending SOL 
Server beyond pure database capabilities and 
further improving its accessibility and man- 
ageability. Microsofts newly released Visual 
Studio Team Edition for Database Profes- 
sionals (Team Data) attempts to mitigate 
the risk involved in making and deploying 
database schema changes. Team Data pro- 
vides centralized management for schema 
changes, offers tools to deploy schema 
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Easy Does it 


Editorial 


changes to your databases, and generates T- 
SQL unit tests for database schema changes. 
For more information about Team Data, 
see the product home page at http://msdn2 


-microsoft.com/en-us/teamsystem/ 
aa718807.aspx and Matt Nunn’s Team Data 


article series at http://wwwsqlmag.com, 
InstantDoc IDs 50303, 92843, 93209, 93533, 
93728, and 94217. 

In addition, Microsoft has recently released 
SOL Server 2005 Service Pack 2 (SP2), a 
sure sign that the SQL Server 2005 release 
has matured. SP2 delivers several important 
updates including data compression, security 
updates, Oracle support for Report Builder, 
integration with Microsoft Office SharePoint 
Portal Server 2007, support for Windows 
Vista, and BI integration with the 2007 Office 
system. 

Microsofts far-reaching plans for SQL 
Server further its goal of enhancing the data- 
base services and features beyond traditional 
relational database services. Dave Camp- 
bell, Microsofts Technical Fellow in charge 
of SQL Server Strategy and Architecture, 
shared some of Microsofts plans for future 
SQL Server editions. Dave mentioned that 
one of the focuses for the next SQL Server 
release, code-named Katmai, is to improve 
the database’s ability to provide “end-to-end 
business insight, strengthening the marriage 
of structured and unstructured data.” Moving 
toward this goal, Microsoft will architect SQL 
Server around an entity model framework 
that enables diverse custom views in SQL 
Servers data store depending on the clients 
requirements. SQL Server has come along 
Way in its quest toward making data more 
accessible and meaningful, and the future 
offers even bigger changes to come. 500 

InstantDoc ID 94715 


Michael Oley (mikeo@windowsitpro.com) is technical 
director for Windows IT Pro and SQL Server Magazine and coau- 
thor of SQL Server 2005 Developer's Guide (Osborne/McGraw-Hill). 
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Letters to the 
Editor 


More on Storing Session State 

I read Susan Perschke’s article ^A Recipe for 
Replacing Session Variables” (March 2006, 
InstantDoc ID 49114), which describes using 
a back-end SQL Server database to store 
session state, and I agree that this is an 
excellent solution. Гуе been using this tech- 
nique for a number of years now. The only 
spin Гуе put on it is that I save the session 
information in the form of an XML docu- 
ment. The back-end SQL table has three 
columns: SessionID (randomly generated), 
Sesion XML (the XML document), and 
SessionExpires, a date/time field indicating 
when to purge the table row. This date-time 
column is updated (one day is added) on 
each visit to the Web server. This aids in 
maintaining the table size during database 
maintenance procedures. 

I’ve created a class library called, oddly 
enough, SessionState. This library is written 
in .NET and incorporates, among others, 
the System.XML namespace and contains 
functions to Add, Update, Delete elements 
and attributes; Create, Clear, Delete session 
objects; and Retrieve and Save the current 
XML document. It basically wraps the 
functionality of System. XML into a small 
set of user-friendly functions for Document 
Object Model manipulation, and wraps 
System.Data for persistence. 

Using this technique, I’ve virtually elimi- 
nated having to pass parameters via URL or 
hidden form fields. The technique has never 
failed and has simplified our development 
efforts. It also has opened the door to true 
load balancing in our Web farm. 

One serendipitous use of this approach 
is that a customer support person can 
“Sump into" another user’s session simply by 
opening a support Web page and selecting 
the appropriate session from a list of saved 
sessions currently in the back-end SQL 
table. The support person can then repro- 
duce any erroneous behavior that the user 
may be reporting. 

I knew I couldnt be the only person 
doing this. It’s just that good.. 

—Michael Lopez 
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Virtualized Analytical Database Servers 
I just read Michael Otey’s editorial “The High Cost of Server Sprawl” (December 2006, 
InstantDoc ID 94062). I always appreciate his perspective. Recently, Гуе been trying to 
get a SQL Server 2005 environment in place at work. This is a Sybase shop, and I'm 
facing, to say the least, some resistance. But the IT staff created a SQL Server 2005 server 
for me—then I realized that it’s running under VMware. The database space I live in is 
analysis and reporting, and not of a transactional nature. I’ve always believed that virtual- 
ization and analytical database servers aren't a good mix, due to the added OS/VMware 
software layer. But the staff here runs the server against a robust SAN, which could 
mitigate potential performance problems. Where does Michael come down on the issue 
of VMware and analytical database server implementations (i.e., data warehouse, data 
marts/dim models, OLAP)? When I searched on the Web, I found little commentary 
on this topic. 

—John E. “Jody” Pilsworth 


Depending on the requirements, I think that running SQL Server/OLAP from a virtual machine 
(VM) using a SAN back end can be successful. AVM won't offer the same performance as a 
physical server, but it can come close, and in most cases can be set up to meet the needs of users. 
One of the most important factors is ensuring that the VM running SQL Server/OLAP has 
been allocated an adequate amount of memory and that you've used a fixed-size virtual hard 


disk. 


Date Formats 

I was disappointed to read an IT pro recom- 
mending anything other than ISO/ODBC 
date formats in a select statement, in Michael 
Otey’s Select Top(X): “Т-5015 Datetime 
Data Type” (September 2004, InstantDoc 
ID 43488). Americans probably dont see 
what the big deal is with writing dates 
"backwards" (mm/dd/yyyy). But there is 
a world outside the United States, and the 
rest of the world writes dates in the more 
logical format of dd/mm/yyyy or yy/mm/ 
dd. More logical because the order of the 
significance of the parts either increases (dd/ 
mm/yyyy, as in UK format) or decreases 
(yy/mm/dd, as in Korean format). The 
illogical US format mixes the significance 
of the parts and is akin to writing a time 
of 30 minutes and 45 seconds past 10:00 
in the morning as 10:45:30 or 45:10:30. I 
was disappointed that Mr. Otey indirectly 
encouraged the representation of dates as 
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—Michael Otey 


“May 15, 2004 4 am,’ “5/15/2004 04:30,” 
and “May 15, 2004.” You might not see the 
significance of this, but in my opinion it’s 
irresponsible of you to publish, in a global 
resource, anything other than unambiguous 
format. 

—Daniel Clarke 


Thanks! 
Dawn Cyr did a great job with the article 
“What Makes YOU an Expert?” (December 
2006, InstantDoc ID 94006). My boss read it 
and said that she would pay for my Micro- 
soft certification. Hopefully, by next fall I 
will have earned the certification. 500 
—Vincent Miller 
InstantDoc ID 94554 


Feedback welcome 

Send your comments to letters@sqlmag.com. Include your full 
name, email address, and daytime phone number. We edit all let- 
ters for style, length, and clarity. 


Www.salmag.com 


PTO for Ihe 
Rest of Us 


Don't just throw hardware at a problem 


ow many circus clowns can you fit 

into a Volkswagen Beetle? Га bet good 
money that I could squeeze 10 clowns into 
one, as long as they were small and I had 
plenty of butter to grease the clowns up. 
(Editors note: No clowns were harmed during the 
writing of this article.) Adding each additional 
clown would become more and more dif- 
ficult, and predicting the theoretical limit of 
how many clowns could squeeze into the car 
would be extremely tough. 

Obviously, 10,000 clowns wouldnt fit. 
What if I reduced the workload—that is, 
decreased the number of clowns I'm trying 
to squeeze through my bottleneck (Le., the 
car) by a factor of 10. A 10x decrease in the 
workload is substantial; I could surely fit just 
1000 clowns into the Beetle. Right? All the 
butter in the world wouldn't get that job 
done. 

What does all this clown imagery have to 
do with SQL Server I/O? Oddly enough, it 
can help us frame a problem that a tremen- 
dously large number of SQL Server cus- 
tomers suffer from—namely, I/O subsystems 
that arent properly equipped to handle the 
workload placed on them. 


The Wrong Approach 
Many customers assume that “adding a faster 
I/O subsystem" will magically solve their 
problems. Perhaps they mistakenly believe 
that stuffing 1000 clowns into a car must 
be easier than stuffing 10,000 clowns in it. 
Alas, hardware is pretty mystical and unap- 
proachable to a lot of software people. We 
don’t visualize the bandwidth and bottleneck 
problems in the same way. 

Suppose your existing SOL Server- 
induced workload is I/O-bound and that 


your I/O subsystem cant keep up. An 
unacceptably large number of SQL Server 
customers—and probably customers of other 
major database platforms—will immediately 
say, "I guess it’s time to buy a better SAN.” 
They'll diligently research SAN options, 
then spend a lot of time and money setting 
up the new SAN. Whether the solution will 
help is a crapshoot unless the customer does 
the necessary due diligence to understand the 
I/O characteristics of the workload he or she 
expects the I/O subsystem to handle—con- 
trasted against the SAN’s actual performance 
and throughput capabilities. Spending hun- 
dreds of thousands of dollars on a new I/O 
subsystem thats five to twenty times faster 
than your current system wont necessarily 
have a material impact on the overall perfor- 
mance of your application if your new SAN 
purchase is the circus equivalent of saying, 
“10,000 clowns wont fit, so lets try 10007" 
Sometimes, throwing hardware at a 
problem works. You'll never squeeze 100 
clowns into a Beetle, but you might be able 
to cram 100 clowns into a school bus rated 
to carry 50 people. It would be a tight fit, 
and the buss performance probably wouldnt 
be up to your expectations, but youd be 
able to drive those clowns around town. 
Sometimes, you'll get lucky while trying to 
solve I/O problems by simply buying more 
1/O—without having a concrete grasp of 
your existing I/O workload requirements. 
However, it’s never a good idea. And you risk 
having to explain to your boss why the new 
six-figure SAN hasnt changed anything. 
There’s no magic formula that tells you 
"how much SAN you need? However, 
if your vendor is willing to take scads of 
your companys hard-earned money without 
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asking you for detailed, low-level I/O-usage 
patterns—and you don't know how to size 
the system yourself—you should consider 
seeking outside assistance to ensure that your 
new I/O capacity is sized and configured for 
your needs. 


The Right Approach 

This columns intent isnt to teach you how 
to be an I/O expert. An important. skill 
among successful IT pros is knowing the 
limits of one’s abilities, recognizing situations 
in which the costs of making the wrong deci- 
sion are substantial, and seeking appropriate 
outside counsel as necessary. But I can’t leave 
you hanging entirely. 

There are countless ways to look at I/O 
information, and SQL Server 2005 provides a 
rich set of tools for monitoring performance 
metrics. However, I've always been a big fan 
offn virtualfilestats, a handy function that lets 
you quickly and easily track the number of 
physical I/O read and write operations that 
happen on a per-file level for SQL Server. It 
tracks the actual number of bytes transferred 
for reads and writes on a per-file basis. It also 
gives you valuable information about the 
total number of I/O stalls that each file in 
your SQL Server instance has experienced. 
All this information can be helpful in under- 
standing the existing I/O patterns of your 
current workload and in properly sizing any 
new I/O subsystem purchase that you're 
contemplating. 


Join Us Online! 

Save the clowns. Size your I/O sub- 

system properly. And be sure to visit SQL 

Server Magazine performance-tuning forums 

(http://sglforums.windowsitpro.com) for 

further advice and tips. 500 
InstantDoc ID 94597 


Brian Moran (brian@solidqualitylearning.com) is 
president of the Northern Virginia SQL Server User's Group and a 
principle mentor and COO with Solid Quality Learning. He is an 
MCDBA and a Microsoft MVP. 
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Editor's Note: Post your feedback and tool 
recommendations on the Tool Time forum at http:// 
sqlforums.windowsitpro.com/web/forum. 


AME 


with 
Kevin) 
Kline 


SOLIOSIM 


Create a realistic 1/0 load for stress- 
testing SQL Server 2005 


С tress-testing an instance of SQL Server 2005 can be difficult. Back in the old days 
of SQL Server 6.0, it was fairly easy to build a test suite of SQL statements that 
represented a realistic server workload. But now, with 64-bit servers and extremely fast 
CPU and disk subsystems, it’s difficult to construct a stress test that can actually stress a 
SQL Server instance. To help you more easily create a realistic stress test, the SQL Server 
Storage Engine team has introduced SQLIOSim, a stress-testing tool that can generate 
a load sufficient to overwork almost any hardware configuration. 


SQLIOSim was created by Bob Dorr, a senior escalation engineer in Microsoft's 
SQL Server Support team, and the tool is now owned by the SQLOS development 
team and program manager, Jerome Halmans. SQLIOSim doesn’t generate an I/O 
load by replaying SQL captured from real sessions connected to the target SOL Server. 
Instead, the tool generates the same type and pattern of I/O requests on a disk sub- 
system as SQL Server would, then verifies that the data is written exactly as SQL Server 
would.You can then use the information that the tool provides to determine whether 
your current disk subsystem is adequate for the application at hand. The key word 
here is simulate because SQLIOSim creates its own I/O stress load; it doesn’t generate 
transactions that you'd actually use against a user database. 


Functionality 

When you download SQLIOSim, you'll get a single, compressed file containing two 

executables: the GUI version of the tool in the SQLIOSim.exe file and the command- 

line version in the SQLIOSim.com file. The compressed file also contains useful sample 

configuration files that you can quickly customize to fit your specific testing needs. 

You have a great deal of flexibility in how you configure the SQL Server I/O stress 

test. For example, you could: 

* test the behavior of DBCC CHECKDB while the system is in use 

* see how bulk-load jobs perform on the disk subsystem 

* evaluate the benefits of single versus multiple file setups for SOL Server data- 
bases 

* see the difference in behavior of OLTP, mixed-use, and OLAP applications by 
tuning the randomness of the requests 


The two versions of the program support a variety of operating parameters, such as 
the duration of the test run and the size of the data file, the number of CPUs on the 
computer, the affinity mask for the CPUs, the maximum available physical memory, 
the number of test cycles, and the cache hit ratio. The blog entry at http://blogs.msdn 


.com/sqlserverstorageengine/archive/2006/10/06/SQLIOSim-available-for-download 


.aspx provides full details about the various command-line switches and configuration 
settings available for SQLIOSim. 
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SQLIOSim 


BENEFITS: Creates a realistic stress-test 
load that accurately simulates any 1/0 pattern 
that SQL Server 2005 could generate. 


SYSTEM REQUIREMENTS: Minimal 
system requirements. The target server needs 
an instance of SQL Server 2005, and you 

can run tests against any SQL Server edition 
running on any supported OS. 


COMMENTS: SQLIOSim isn't a performance- 
measurement tool. It's a stress-testing 

tool that can generate a load capable of 
overwhelming most disk subsystems. 


HOW TO GET IT: Download the tool in a 
compressed file from the SQL Server Storage 


Engine Blog at http://blogs.msdn.com/ 


sqlserverstorageengine/archive/2006/10/06/ 
SQLIOSim-available-for-download.aspx. 


By default, the output of SQLIOSim is 
stored in an XML file called SQLIOSim. 
log.xml, from which you can extract the 
raw data and manipulate it as needed. 
But remember that SOLIOSim is not 
a performance-measurement tool. Its 
a stress-testing tool that can generate a 
load capable of overwhelming most disk 
subsystems, even powerful, multi-spindle 
RAIDs. Therefore, I recommend that 
during your tests, you track several specific 
Windows Performance Monitor counters: 
disk sec/read, disk sec/transfer, disk sec/ 
write, disk bytes/sec, and queue lengths. 
If SQLIOSim finds any errors, they'll be 
reported in the log file. 

SQLIOSim is a must-have utility for 
developers and DBAs who are building 
highly scalable applications for the SQL 
Server platform. Be sure to visit the Tool 
Time forum at http://sqlforums.windows 
itpro.com/web/forum and post your com- 
ments and tool recommendations. В 

InstantDoc ID 94473 


Kevin Kline (kevin.kline@quest.com) is the director of 
technology for SQL Server Solutions at Quest Software, president 
of the international Professional Association for SQL Server (PASS), 
and the author of SQL in a Nutshell, 2nd edition (O'Reilly Media). 
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SELECT vs. SET: Oplimizing 
Loops 

Loops are fairly common in SQL Server 
stored procedures. If you discover a loop in a 
stored procedure, you might find that the code 
iterates thousands of times before the loop 
exits. One way to improve the performance of 
loops is to optimize variable handling. 

Do you know the difference between 
using the SELECT and SET commands 
to assign values to variable? Many SQL 
Server developers believe that the com- 
mands perform the same function, except 
that SELECT was designed to return data, 
whereas SET is optimized to assign values 
to local variables; therefore, most developers 
use SET to change variables. This action is 
correct most of the time. 

Certainly, if you're setting a variable 
value, SET is the recommended command; 
however, sometimes SET isnt the best 
command for the job. Every time you use 
the SET command, an assignation language 
element executes. Thus, if you're setting 
multiple variables, each SET command runs 
like a SELECT (Qyariable statement. Con- 
sider the following two statements, which 
are functionally equivalent: 


SET @10пе = 1; 
SET aiTwo = 2; 
SET @1Тһгее = 3; 
SET @iFour = 4; 


SELECT 

aine = 1 
aiTwo = 2, 
giThree = 3, 
giFour = 4; 


Although the statements are similar, the 
SELECT statement runs significantly faster 
than the SET statement. Each SET state- 
ment runs individually and updates one 
value per execution, whereas the entire 
SELECT statement runs as a whole and 
updates all four values in one execution. 
To test this action, I ran each statement 
in a loop one million times. I found that the 
SET block ran in 0.0094 milliseconds (ms) 
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on average and the SELECT statement ran 
in only 0.0039 ms. The SELECT statement 
ran 59 percent faster than the SET statement. 
If you're looping through a query only a few 
hundred thousand times, you probably wont 
notice a difference between the speed of the 
two commands; however, the difference in 
speed might be important to an end user 
who must wait 10 seconds rather than just 3 
seconds for a report to generate. 

Another thing to consider is that you can 
embed your variable updates in preexisting 
SELECT and UPDATE statements within a 
loop. In the benchmark tests I ran, each vari- 
able that I added to a SELECT or UPDATE 
statement required an additional 0.00016 
ms. By comparison, adding a SET statement 
required 0.0027 ms. I was surprised to learn 
that adding a SET statement introduces 
a processing delay that is 1687.5 percent 
longer than the processing delay caused by 
adding a variable to a previously existing 
SELECT assignation statement. If you're 
looping through rows, you can further expe- 
dite your loop by altering multiple variables in 
one UPDATE statement, as Listing 1 shows. 

—Patrick Caldwell 
InstantDoc ID 94555 


Troubleshooting Performance 
Issues 

Problem: Querying Tables and Views on 
a Linked Server 

Michael is a database consultant who is 
working on a project at a client’s site. He 
needs to create a SQL Server 2000 data 
warehouse that integrates data from the 
company’s other databases. Michael plans to 
use the linked server feature to write some 
of the scripts that will migrate the data and 
perform distributed queries. 

One data source that he must integrate 
is an IBM DB2 database. He used the IBM 
OLE DB Provider for DB2 to create a 
linked server called DB2_SRVR1 for the 
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LISTING I Altering Multiple 
ariables in an UPDATE Statement 


UPDATE MyTable SET 
Optimized = True, 
aine = 1, 
giTwo = 2, 
giThree = 3, 
giFour АУ 
giLoop а 


1їбор + 1; 


database. There are certain tables and views 
that he wants to query from the DB2 server 
on an ad hoc basis or use in his scripts, but 
when he tries to query one such table using 
the following four-part name 


SELECT * FROM DB2 SRVRT.DB CAT. 
SALES.SALES SUMMARY 


he gets the following error 


Msg 7314, Level 16, State 1, Line 1 
The OLE DB provider "IBMDADB2" 
for Linked server "DB2_SRVR1" 
does not contain the table ""DB_ 
CAT"."SALES"."SALES SUMMARY"". 
The table either does not exist 
or the current user does not have 
permissions on that table. 


Help Michael Do the Following: 

1.Find the list of tables or views as 
exposed by the data source that he can easily 
query from SQL Server on a linked server. 

2. Quickly determine the correct way 
to specify the four-part name for the DB2 
table (1.е., the catalog and schema part of the 
four-part name). 


To see how one of our savvy readers 
solved this problem and collected $100, head 
to our Web site and link to InstantDoc ID 
48378. You can join the challenge by sub- 
scribing to SQL Server Magazine UPDATE, 
a free weekly email newsletter with exclusive 
commentary by Brian Moran. Sign up now 
at http://www.sqlmag.com/emiail. 5090 

—Umachandar Jayachandran 
InstantDoc ID 48378. 


Share Your Experiences 

Share your SQL Server code, comments, discoveries, and solutions to 
problems. Email your contributions to r2r&sqlmag.com. Please include 
your full name and phone number. We edit submissions for style, 
grammar, and length. If we print your submission, you'll get $100. 
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he key to great database performance 

hes in finding ways to help SQL 
Server more quickly save or retrieve 
data and reduce its response time. In my 
previous article, "Database Design for Per- 
formance,’ (November 2006, InstantDoc 
ID 93633), I explained how database 
design affects performance. Building on 
that foundation, lets look now at three 
essential areas related to database design: 
indexing, maintenance, and statistics. All 
three are interrelated: When you have the 
right indexes, database maintenance will 
be effective, and effective database main- 
tenance includes updating statistics, which 
helps SOL Server better use the indexes 
when responding to a query. 


Without going through all of the details 
about how to best index, I can recom- 
mend some general guidelines you should 
follow. First, choose the clustering key. 
Next, add your primary and unique 
constraint. Manually index your for- 
eign keys. Finally, leverage tools such as 
Database Engine Tuning Advisor to help 
you do some workload tuning. For more 
information about this tool, see the SQL 
Server 2005 Books Online topic “Data- 
base Engine Tuning Advisor Overview" 
at http://msdn2.microsoft.com/En-US/ 
library/ms188639.aspx 

~~ However, this is not to say that indexing 
for performance is simple—you need to 
consider many factors. Га like to focus on 
two areas: clustered indexes and secondary, 
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or nonclustered, indexes. Questions to 
consider include the following: Should 
every table have a clustered index? Is just 
the existence of a clustered index good 
enough? Are all clustered indexes equally 
effective? With nonclustered indexes, does 
the selectivity of the high-order element 
matter? Should nonclustered indexes be 
wider—that is, should they include more 
columns? How much can these indexes 
really help SQL Server to retrieve data 
more quickly? 


When you create the key to a clustered 
index, you need to be aware of several 
factors. Because of how the storage engine 
has changed from the way that SQL 
Server 6.5 handled base tables, in SQL 
Server 7.0 and later releases the important 
things that I look for in a clustering key 
are that it’s unique, narrow, and static. 
Unique. A clustering key should be 
unique because it’s used as the lookup key 
for all nonclustered indexes. For example, 
imagine an index in the back of a book. 
To enable you to find the data that an 
index entry points to, that index entry 
must be unique. Otherwise, you wouldn't 
find the exact item you're looking for. 
Similarly, the clustered index needs to 
be unique. However, SQL Server doesn’t 
require that your clustering key be created 
on a unique column. You can create it 
on any column. If the clustering key isn’t 
unique, SQL Server will make it unique 
by adding a four-byte integer to the data. 
Just realize that creating the clustered 
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index on a nonunique clustering key 
causes additional overhead at index cre- 
ation, wastes disk space, creates additional 
costs during INSERTs and UPDATEs, 
and in SQL Server 2000, adds the cost of 
a clustered index rebuild, which is more 
likely to be needed because of the poor 
choice of clustering key. 

Narrow. A clustering key should be 
narrow (i.e., composed of as few columns 
as possible), for some of the same reasons 
it should be unique. Because the clus- 
tering key is used as the lookup key for all 
nonclustered indexes, the clustering key is 
duplicated in all nonclustered indexes. If 
the clustering key is too wide (1.е., com- 
posed of more columns than it needs to 
be), then all of the nonclustered indexes 
will be unnecessarily wide, which wastes 
disk space, creates additional costs during 
INSERTs and UPDATEs, and requires 
more time (because of the greater size) 
to rebuild these index structures. So, what 
does narrow mean? It means using as few 
bytes as possible to help uniquely define 
your rows—a narrow numeric when pos- 
sible, as SQL Server handles numeric data 
types more efficiently than it does most 
other data types. 

Static. A clustering key should be static 
for some of the same reasons it should be 
unique and narrow. If the clustering key 
is used as the lookup key for all nonclus- 
tered indexes, then the clustering key is 
duplicated in all nonclustered indexes. In 
fact, for a given table, the clustering key 
will be the most-duplicated data. If this 
data changes, then the value will have to 
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In SQL Server 2000, the only SQL Server function for GUIDs is newid, but 
this function doesn't create an ever-increasing pattern. In SOL Server 2005, 
you can use a new GUID function called newsequentialid() to populate your 
uniqueidentifier column. Here's an example of how you can use it: 


CREATE TABLE Test 
( 
TestID uniqueidentifier 


CONSTRAINT Test TestID Default 
DEFAULT newsequentialid(), 


Inserted datetime 


CONSTRAINT Test Inserted Default 


DEFAULT getdate() 
) 


go 


INSERT Test DEFAULT VALUES 
go 


SELECT * FROM Test 
go 


Is there a way to create a sequential GUID in SQL Server 2000? Yes—you can 
use an extended procedure to generate sequential GUIDs or you can leverage 
someone else's code. Gert Drapers wrote an extended stored procedure, which 
he has published on his Web site, SQLDev.NET, at http://sqldev.net/xp/xpguid 


.htm. 


be updated in the base table as well as in 
every nonclustered index. If the key changes, 
it will cause the record to move. When a 
record moves, it creates fragmentation. Like 
unnecessarily wide, nonclustered indexes, 
fragmentation wastes disk space and cre- 
ates additional costs during INSERTs and 
UPDATEs. Fragmentation also increases 
the time required to perform data updates 
(because of record relocation and the likely 
need for subsequent splits) and requires 
more maintenance. 

Typically, I recommend using a numeric 
IDENTITY column as the clustering key, 
but I'm frequently asked about using a glob- 
ally unique identifier (GUID). A GUID does 
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meet the criteria fairly well: Its unique, usually 
static, and relatively narrow. So, whats wrong 
with using GUID? Apart from being large and 
somewhat incomprehensible, in SOL Server 
2000, the function that generates GUID 
values—newid()—doesn’t create an ever- 
increasing pattern as an IDENTITY column 
would. The ability to create an ever-increasing 
pattern isn’t one of the primary criteria I look 
for in a clustering key, but it does add many 
benefits. Without an ever-increasing pattern, 
your table is likely to become fragmented and 
perform poorly. For more information about 
GUID, see the sidebar “Using the newsequen- 
tialid() GUID Function.” 

If the clustering key is ever increasing, 


then new rows have a specific location 
where they can be placed. If that location 
is at the end of the table, then the new row 
needs space allocated to it, but SQL Server 
doesn’t have to make space in the middle 
of the table. If a row is inserted in a loca- 
tion that doesn’t have any room, then SQL 
Server needs to make room. So, if you insert 
a row based on last name, then as rows come 
in, space will need to be made where that 
name should be placed. To make room, SQL 
Server makes a split. 

Splits in SQL Server аге 50/50 splits. 
Simply put, 50 percent of the data stays and 
50 percent of the data is moved. This keeps 
the index logically intact even though it’s 
not physically intact. When an index has a 
lot of splits, we call that index fragmented. 

Good examples of an index that is ever 
increasing are IDENTITY columns, which 
are also naturally unique, static, and narrow. 
Another example is something that meets as 
many of these criteria as possible, such as a 
datetime column, or even better than that, a 
composite key of datetime + identity. 


Nonclustered Indexes 
The general strategy to take is that it’s better 
to have fewer, but wider composite indexes 
than to have many narrow indexes. Narrow 
indexes, such as single-column indexes, have 
fewer uses than wider indexes. I’ve seen a 
lot of debates over the selectivity of the first 
column (known as the high-order element) 
of the index, but it’s not really important 
whether the first column is the one that’s 
most frequently used, and that’s not my 
primary focus around selecting nonclustered 
indexes. When you're choosing the right 
nonclustered indexes, it’s more important 
to “know the system” and understand how 
SQL Server uses indexes rather than assume 
general criteria about the first column. 
The high-order element of the indexes 
is important; however, the element doesn’t 
need to be highly selective for the index 
to be useful. (Note that the selectivity of 
an index depends upon the percentage of 
rows in a table having the same value for 
the indexed key. An index’s selectivity is 
optimal if few rows have the same value.) 
Let’s consider a hypothetical table that’s very 
wide and that covers personal data similar to 
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that of the census data for the United States. 
This table is tracking a lot of items, and the 
table width averages 1200 bytes per row. 
Using our knowledge of page densities and 
record format, we can see that we can fit 
only an average of six rows per page. If the 
table stores 300 million rows at six rows per 
page, the table will be 381GB in size. Gen- 
erally, a table of this size would be difficult 
(and potentially slow) to analyze. However, 
ifa common aggregate query for the table is 
one that returns the number of households 
by “HeadofHousehold Gender,’ then “Age,” 
then “Dependents,” we're looking at a query 
that needs only a small subset of columns 
from the table. 


“Consider rebuilding 
your table if 

you have 25 
percent or greater 
fragmentation.” 


Additionally, based on the column order, 
this index is also useful for counting 
rows by HeadofHouseholdGender alone 
or HeadofHousehold Gender and Age 
together. You can also use this index for 
any left-based subset of columns, that is, 
columns that comprise the left portion of 
the index. The point is, the high-order ele- 
ment (HeadOfHouseholdGender) is not 
very selective, yet this index is useful for 
a variety of aggregates. Another thing that 
makes this index so effective is its size. With 
three columns that are likely to be stored as 
a bit (Gender), a tinyint (Dependents), and 
another tinyint (Age), the total for this index 
key—including an index row header (four 
bytes) and the clustering key (about eight 
bytes)—1s 15 bytes per row. Because this row 
is so narrow, SQL Server can fit 539 rows 
per page. The personal data table stores 300 
million records, yet the index is only 4GB 
in size.A 4GB structure is significantly more 
optimal to read than if you have to read the 
entire table. Also, if you have the data ordered 
appropriately for the Group By command 
that you need to retrieve, then SQL Server 
can achieve a stream aggregate rather than a 


hash aggregate, which helps the query per- 
form. Additionally, if this data is read-only, as 
census data would be, you can also consider 
using more interesting forms of indexes 
such as those created by Indexed Views. 
I'm not saying you can't create an indexed 
view on transaction processing systems, but 
there are more possibilities of blocking on a 
transaction processing system. 


Maintenance 

When data changes, we need to perform 
maintenance. Maintenance helps keep your 
tables contiguous and your pages denser; it 
also helps improve resource utilization and 
therefore improves overall performance. But 
how do you maintain your tables, and what 
does it really mean to defragment a table? 
This topic is fairly complex, but here are a 
few things to think about and review. 

In SQL Server 2005, you can use the 
sys.dm_db_index_physical_stats dynamic 
management function to determine how 
fragmented your table is. Use this function 
to get a feel for how much and how fast 
fragmentation is occurring. Also, consider 
rebuilding your table if you have 25 percent 
or greater fragmentation, you have a dedi- 
cated maintenance window and ample disk 
and log space, and you can rebuild online. 

Consider defragmenting your table if you 
can't rebuild online, you dont have more 
than 25 percent fragmentation, and you cant 
afford the disk or log space to rebuild. 


Statistics 

Because statistics are the optimizer’s source 
for estimating how much data will be 
processed, they're crucial for better per- 
formance. Statistics are used with indexes, 
but standalone statistics (statistics that are 
created in addition to indexes) can also 
help to improve a variety of optimization 
strategies as well as improve the usefulness 
of a composite nonclustered index. This is 
also complex, but here are a few things to 
think about and do: First, make sure that the 
database option "auto create statistics" 1s on. 
(It’s on by default.) Second, make sure that 
the database option "auto update statistics" 
is on. (Its on by default.) Third, consider 
using the sp. createstats stored procedure to 
create additional statistics on the secondary 
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columns of your nonclustered indexes. Use 
the following command: 


sp createstats 'indexonly', 


' fullscan' 


Finally realize that certain correlations 
between columns cant be perfectly described 
by statistics alone. Sometimes the only way 
to answer a query is with the right index. 


Resulls Malch Effort 


If you design with performance in mind, the 
rewards to your business can be huge. With 
careful thought and attention to indexing, 
maintenance, and statistics, as well as database 
design, you'll be the hero who designed for 
performance—and achieved it. 500 
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by Roman Rehak 


W ith each new SQL Server release, it becomes increasingly clear that the product is 
no longer just a database. SQL Server is a powerful application platform, loaded 
| with capabilities to enhance and complement its traditional database features. Among 
other benefits, this ongoing development of the product greatly decreases the need 
Of IIS afi g Ihi І rd- to rely on external or third-party applications to create robust, feature-rich enterprise 
database solutions. The new Native XML Web Services feature in SQL Server 2005 

p g rtu g p р li Ica ti ons removes dependency on IIS to expose standards-based, secure Web services. 
lo cfea le y OUr The ability to serve Web services from SQL Server isnt entirely new. The feature is 
provided in SQL Server 2000 through the Microsoft SQL Server 2000 Web Services 
own fe a IU fe- Toolkit and SQLXML. However, the XML Web services implementation in SQL Server 
е . 2005 greatly enhances the feature while making it more efficient, more secure, and easier 
fic h en le гр п5е to manage. And the feature is no longer dependent on Microsoft IIS. The Native XML 
d а [а b ose Web Services feature supports many Web services standards such as SOAP 1.1 and 1.2 
. and standard Web Services Definition Language (WSDL). In this article, I explain how 
SO | U H ONS Фе Native XML Web Services feature works, how to implement it, and how to code 
client applications. I also cover security, best practices, and recommendations for using the 
feature.You can download the project files for the examples in this article at http://www 
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Native XML Web Services Implementation Baa rer at 


Web service requests communicate with SQL Server 2005 

by using the new protocol SOAP over HTTP. In this protocol, HTTP calls are 
intercepted by a listener driver called http.sys. This kernel-mode component pro- 
cesses HTTP requests and routes them to applications that have registered a 
particular URL path with http.sys. If the URL you're requesting has been reg- 
istered, the HTTP handler sends the request to SQL Server through the http 
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sys API. Thus, SQL Server become another 
consumer for HTTP requests, removing 
the need for using IIS with Web services. A 
restriction exists, though: http.sys is currently 
implemented only on Windows Server 2003 
and Windows XP Service Pack 2 (SP2), so if 
you consider using Native XML Web Ser- 
vices, your SQL Server has to be installed on 
one of these OSs. 

You create Web services by establishing 
one or more SOAP endpoints on the server. 
(SQL Server 2005 has several types of end- 
points, such as the Database Mirroring or 
Service Broker endpoints.) You could view a 
SOAP endpoint as an equivalent of the Web- 
Service class in .NET; it’s a point of contact 
for chent applications. In each endpoint, you 
expose one or more stored procedures or 
scalar user-defined functions (UDFs) as Web 
methods. Although its not recommended, 
you can configure the endpoint to allow 
ad hoc execution of T-SQL batches; but 
because of its security risks, this feature is off 
by default and use of it is highly discouraged. 
Surprisingly, no UI tool exists for creating 
and managing endpoints. You have to use 
your T-SQL skills and master the art of using 
the CREATE ENDPOINT, DROP END- 
POINT and ALTER. ENDPOINT com- 
mands. Listing 1 shows the most common 
options for the CREATE ENDPOINT 
command when creating a SOAP endpoint. 
T Il discuss only these most common options; 
I wont discuss options for endpoints other 
than the SOAP type. 

You control the state of the endpoint 
by using the STARTED, STOPPED, or 
DISABLED setting for the STATE option, 
as Listing 1 shows. When the endpoint is 


[LISTING | Basic Syntax for CREATE ENDPOINT 


CREATE ENDPOINT MyEndpointName 
STATE = € STARTED | STOPPED | DISABLED } 
AS HTTP ( 


stopped, it still responds to requests but 
returns an error. The stopped state can be 
useful for minimizing the timeframe of 
exposure. For example, you can run a couple 
of scheduled jobs and start an endpoint 
before scheduled data transfers, then stop 
it when the transfers are finished. Disabling 
the endpoint turns off all functionality. 

The next few options in Listing 1 
are HTTP related. The SITE and PATH 
options determine the Web service URL. 
The SITE setting configures the first part 
of the URL after “http.” You can define a 
specific Web address (using computer name, 
localhost, or an IP address), or you can use 
one of the wildcards. The asterisk (*) wild- 
card lets you use all possible host names that 
haven't been explicitly registered with http. 
sys by other applications. The plus sign (+) 
wildcard enables the use of any host name. 
The best option is to use the * because it 
prevents potential conflicts with other regis- 
tered URLs while giving you the flexibility 
of using different address formats. Here’s 
what a sample Web service URL looks like 
after setting a site to myserver and path to 
/sql/mysqlendpoint: 


http://myserver/sql/mysqlendpoint 


The two other important HTTP end- 
point options are PORTS and AUTHEN- 
TICATION. You use the PORTS option to 
configure whether the Web service will work 
with HTTP, HTTPS, or both. For security 
reasons, Microsoft highly recommends that 
you require SSL if your Web service will be 
called from outside of your network. The 
AUTHENTICATION option determines 
the type of HTTP authen- 
tication, which can be one 
several types: Basic, Digest, 
NTLM, Kerberos, or Inte- 


SITE = {'*' | '+' | 'webSite' } : 

PATH = 'url', Й grated. These options аге 

AUTHENTICATION -( BASIC | DIGEST | a ҺЕ 
INTEGRATED | NTLM | KERBEROS 5 E ,...n J), Шаг to authentication 


PORTS SC x6 CLEA || SSil IE pace 


) 

FOR SOAP € 
WEBMETHOD Г 'namespace' 
NAME = 'database.owner.name' 
SCHEMA = < NONE | STANDARD | 


NES en ES 
BATCHES = { ENABLED | 
LOGIN TYPE = < MIXED | WINDOWS > 
} 
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inge 


adl methodi alias' 


DEFAULT } 
FORMAT = € ALL RESULTS | ROWSETS ONLY | NONE? 


DISABLED ), 
WSDL = { NONE | DEFAULT | 'sp name' }, 


that IIS uses, with one 
major difference: SQL 
Server doesnt allow the 
anonymous option because 
of the sensitive nature of 
accessing data over a Web 
service. Another difference 
is that you'll need Basic 
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authentication if your server is running 
mixed authentication and you want to pass 
SQL Server credentials. You have to use valid 
Windows credentials to be authenticated, 
either in a domain or locally. Also, because 
Basic authentication sends credentials in clear 
text, this option is supported only when the 
endpoint is configured to require SSL. If you 
try to use the combination of AUTHEN- 
TICATION = (BASIC, ...) and PORTS = 
(CLEAR, ...), you'll get the following error: 
The ‘CLEAR’ and ‘BASIC’ options are not 
allowed on the same statement. You'll have to set 
up the port to allow connections only over 
HTTPS by specifying PORTS = (SSL). 

Now, let’s look at a few SOAP-specific 
options for creating an endpoint. You use 
these options to configure what database 
objects you want to expose as Web services, 
what type of .NET objects will be used 
as return types, what type of SQL Server 
authentication you want to use, the WSDL 
generation type, and whether the endpoint 
should support T-SQL batches. 

The most important part of the SOAP 
section in Listing 1 is one or more WEB- 
METHOD settings. This is the place where 
you expose your stored procedures and 
scalar UDFs as public Web methods. The 
WEBMETHOD- method alias statement 
defines the public name for your Web 
method. This is the name that client applica- 
tions will use. The NAME- database.owner. 
name’ setting maps that public function to 
the database object you want to expose. The 
public alias doesn’t have to match the internal 
object name. In fact, SQL Server experts 
recommend that you don’t use the same 
name so that you hide inner database details 
as much as possible from potential hackers. 

After defining one or more WEB- 
METHOD sections, you have a few more 
options to set. Native XML Web Services 
support both Mixed and Windows-only 
authentication. You configure this option by 
setting LOGIN TYPE to WINDOWS or 
MIXED (WINDOWS 1s the default). Note 
that if you decide to use Mixed authentica- 
tion, you'll have to set up the port to allow 
only HTTPS access, as I mentioned earlier 
when I explained using Basic HTTP authen- 
tication. Again, the same reason applies—we 
don’t want unencrypted network packets 
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transporting usernames and passwords in 
clear text. Also note that you'll need to use 
Basc HTTP authentication with. Mixed 
SQL authentication because the other secu- 
rity types wont be translatable against the 
SQL Server authentication engine. If you set 
BATCHES-ENABLED (the default is dis- 
abled), SOL Server will add a method called 
sglbatch() to the endpoint. This method 
takes two parameters: a string containing 
your T-SQL batch and an optional array of 
SqlParameter objects. As I already mentioned, 
you should enable this option only when 
absolutely necessary, and you need to be 
aware of security implications. 

You have three options for WSDL gen- 
eration. You can specify DEFAULT to gen- 
erate standard WSDL, you can use NONE 
if you don’t want to expose your WSDL, or 
you can set the option to point to a stored 
procedure that uses the StoredProcedure- 
Name setting, then generate your own 
custom WSDL in that stored procedure. 
Using this option gives you more flexibility 
for supporting non-Microsoft Web services, 
development environments, and toolkits 
because you can tweak the WSDL to sup- 
port whatever format they require. 

Once you've created an endpoint, you 
can retrieve the WSDL from the endpoint by 
appending ?usdl to the Web service URL: 


http://servername/endpointname?wsdl 


The WSDL you get back is considered 
"default WSDL;" and it supports the new 
SQL Server 2005 data types. If you're using 
Visual Studio 2003 or another develop- 
ment environment, you can request "simple 


WSDL’ by using this URL format: 


PP LISTING 2 Creating a Stored Procedure 


CREATE PROCEDURE Edbol.LGetFragmentedIndexesl 
‹ 


@Регсепїаде int = 70 
) 
AS 


SELECT object name(Cobject id) AS TableName, 


(SELECT QUOTENAME (name) 
FROM sys.indexes ind 
WHERE 


AS AverageFragmentation, * 
FROM 
sys.dm_db_index_physical_stats 


(db_id('AdventureWorks'), NULL, NULL, NULL, 
WHERE avg fragmentation in percent > gPercentage 


and index id » 


ORDER BY avg fragmentation in percent DESC 


GO 
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ind.object id - dm ind.object id 
AND ind.index id = dm ind.index id) AS IndexName, 
CAST(avg, fragmentation in percent as numeric(10,2)) 


http://servername/endpointname 
?wsdlsimple 


The simple WSDL uses primitive XSD 
data types, thus providing better backward 
compatibility. 

The SCHEMA setting deter- 
mines whether SQL Server returns 
the XSD schema for the method with 
the resultset (SCHEMA-STANDAR D) or 
not (SCHEMA-NONE). You don't have 
to request schema for Web methods 
mapped to scalar UDFs and stored pro- 
cedures that use FOR. XML. You have to 
request schema when executing a stored 
procedure or a T-SQL batch that returns a 
tabular resultset. If you want schema with 
the FOR. XML type of procedure, you 
need to specify XMLSCHEMA in the 
SELECT statement. If you dont request 
schema when calling an endpoint Web 
method mapped to a FOR. XML stored 
procedure, you'll still be able to load the 
resultset into an XmlElement object. 

This process is a litde different if you 
want to work with a DataSet object. If you 
specify SCHEMA=NONE, the Web ser- 
vice returns a dataset, and without a schema, 
you'll get an error in your .NET code when 
you try to access a DataTable object in the 
returned dataset. 

The last Web method option ГЇЇ men- 
tion is FORMAT. The default setting is 
ALL_RESULTS, for which SQL Server 
returns an array of objects containing a result 
set (either a dataset or an XML element) plus 
a few additional objects such as row count, 
SQL Server errors and warnings, stored 
procedure output parameters, and results of 
PRINT statements. If you don’t want all that 
extra stuff, you can 
optimize the Web 
method by speci- 
fying FORMAT 
= ROWSETS_ 
ONLY and you 
will get back just 
the result set. 


Now, let's 
create a stored 

'LIMITED') dm ind 
procedure and 


expose it as a Web 
method. For my 
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example, I wanted to create something that 
could be used in the real world. One area in 
which I expect Native XML Web Services 
to be used a lot is remote database moni- 
toring. Monitoring SQL Server installations 
behind firewalls isn’t easy. But if you expose 
some monitoring and management stored 
procedures as Web services, you should be 
able to connect much more easily through 
НТТР as long as your firewall routes the 
HTTP traffic to your SQL Server. 

Listing 2 shows the code that creates a 
stored procedure that returns a list of indexes 
in which fragmentation is greater than the 
specified parameter. The stored procedure 
uses the new dynamic management function 
sys.dm_db_index_physical_stats. (Note that this 
function is the SQL Server 2005 replacement 
for the DBCC SHOWCONTIG command.) 
The next step is to run the code in Listing 3 
to create an endpomt. When you run the 
script, SQL Server creates an endpoint called 
DBAdministration. This endpoint will have 
the GetFragmentedIndexes method mapped to 
a stored procedure of the same name in the 
AdventureWorks sample database. 

Once you create the endpoint, you can 
start creating a client application in Visual 
Studio. The first step is to right-click the 
project and select Add Web Reference. Next, 
type the URL for WSDL as specified when 
you created the endpoint. On my computer, 
the URL is http://rehakr/sql/dba?wsdl, as 
you can see in Figure 1. Click Add Refer- 
ence, and you're ready to start coding. First, 
you create an instance of the Web service 
and set credentials. In this case, I use the 
credentials of the logged-on user: 


LISTING 3 Creating the 
DBAdministration Endpoint 


CREATE ENDPOINT DBAdministration 
STATE - STARTED 


AS HTTPC 
PATH = '/sql/dba', 
AUTHENTICATION = (INTEGRATED ), 
PORTS = ( CLEAR, SSL ), 
SITE = '*' 

) 

FOR SOAP € 


WEBMETHOD 'http://Adventure-Works/ 
'.'GetFragmentedIndexes' 
(NAME='AdventureWorks.dbo.Get 
FragmentedIndexes', 
SCHEMA=STANDARD ), 

LOGIN_TYPE = WINDOWS, 

WSDL = DEFAULT, 


DATABASE = 'AdventureWorks', 
NAMESPACE = 'http://Adventure- 
Works/" 
) 
GO 
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DBAdministration ws = 
DBAdministration(); 
ws.Credentials = 


new 


System. 
Net.CredentialCache. 
DefaultCredentials; 


Next, call the Web service.The return object 
is an array of objects: 


objectL] results = ws.Get 
FragmentedIndexes(int. 
Parse(txtFragPercent. 


Text)); 


Because the return object contains many 
types of objects, you need to loop through 
the array and find the type of object you're 
looking for. To get the resultset, we need to 
search for a DataSet object: 


DataSet ds = null; 
for (int i = 0; i< 
results. Length; i++) 


object result = 
resultsLil; 

if (result.ToString() == 
"System.Data.DataSet") 


t 

ds = (System.Data.DataSet) 
resultsL i1; 

break; 
} 

} 


As you can see, you need to do some 
extra work to get the data from the return 
object. Because this is the same code you'll 
have to use in every client application, I rec- 
ommend that you create a helper object that 
implements methods such as GetDataSet() 
or GetXmlElement() to minimize coding 
the same plumbing over and over. Please 
consult SQL Server 2005 Books Online 
(BOL) to get the complete list of possible 
objects returned by an endpoint. Figure 2 
shows a grid displaying the results of calling 
GetFragmentedIndexes(80). 


Security Recommendations and 
Best Practices 

The most basic security advice I can give 
you is to stick to the defaults as much as you 
can because the design of Native XML Web 
Services is heavily security focused. Use the 


I6 = February 2007 


default Windows-only authentication, keep 
T-SQL batches disabled, use SSL, and utilize 
Kerberos for HTTP authentication. 
Although Native XML Web Services 
offers new options for data access, you need 
to be careful about when you consider 
using them. The most important thing you 
should know is that the overhead of making 
a SOAP call is much higher than using 
ADO.NET. In my own benchmark, I could 
see that stored procedures with minimum 
duration time (1ms to 2ms) executed about 
15-20 times slower. As the length of execu- 
tion time increases, the overhead becomes 
less significant, but my results clearly show 
that SOAP access is not the best choice 
on systems that have heavy loads in which 
you need to process high volumes of short 
OLTP transactions. SOAP is also not the 
best choice for returning very large result 


load. Native XML Web Services can also be 
useful if you need Web-service functionality 
without having to use IIS, if you require 
zero-footprint for data access on your cli- 
ents, and if your applications don’t require 
the use of a middle-tier layer. I also already 
showed another useful scenario, remote 
database monitoring over HTTP without 
using IIS. You shouldn't blindly use this fea- 
ture, but when you take into consideration 
all the performance, security, and scalability 
implications, it can be a useful part of your 
enterprise architecture. 500 

InstantDoc ID 94536. 


Roman Rehak (roman@arianna.net) is a developer, 
author, and speaker based in Burlington, Vermont. He is a SQL 
Server MVP and an active member of the Professional Association 
for SQL Server (PASS). 


sets or retrieving 
binary objects. 
Another big 
concern is scal- 
ability. Because an 
endpoint essen- 
tially replaces 
your middle tier, 
it can become a 
bottleneck. Unlike 
when you use a 
Web farm with 
.NET Web ser- 
vices as a middle 
tier, you cant 
easily scale out a 
SOAP endpoint > 
because it’s tied to 
a single instance of 
SQL Server. 
However, it 
can make sense 
to use this feature 
in heterogeneous 
environments in 
which you need 
to expose your 
data easily to non- 
Microsoft clients,as 
long as your SQL 
Server is expected 
to handle only a 
slow to medium 
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Meet Microsoft developers and DBAs from around the 
world and build a network of peers to stay in touch with. 


Obtain the most relevant technical advice from Microsoft's 
SQL Server teams on development and deployment and 
hear the latest on ASP.NET, Visual Studio, and SharePoint. 


Attend dynamic Microsoft keynotes and get the scoop on 
the future trends in our industry. 


Tap into opportunities to get your tough questions 
answered during the Microsoft Unplugged night. 


Keep your competitive edge by staying on top of the latest 
technology and visit sessions in the co-located events at 
no extra charge. 


Network with industry heroes and authors of the books and 
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Explore the expo hall, pick up cool giveaways, and enter the 
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for the bulk of the time and helping to launch every release of Visual Studio since Visual Studio 97. Prior to joining Microsoft, 
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the rare occasion when he gets to sleep, he dreams almost entirely in C#. 
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BULK IMPORTING DATA 


This session will describe how to bulk import data into SQL Server efficiently 
taking advantage of parallelism and minimal logging. This session will also 
describe the new OPENROWSET BULK operator and how it can be used for 
importing data in ways that is not possible through BCP or Bulk Insert. 


BEST USE OF TEMPDB IN SQL SERVER 2005 


Is TempDB slowing your applications down? This session describes how SQL 
Server 2005 uses Tempdb to process queries, to create indexes, to store row 
versions and more. It also provides a step-by-step guideline on how to moni- 
tor/troubleshoot both the performance and the space problems in TempDB. 


DATABASE APPLICATION PROGRAMMING WITH SQL SERVER 2005 


This session takes a look at how to build robust and efficient applications 
in a highly productive way using various enhancements in SQL Server 
2005. The session explores how to best work with cursors given client and 
server-side enhancements including the ability to open multiple active 
results. The session also covers how new exception handling improvements 
in the server programming model and the ability to write functions and 
procedures in CLR languages that interoperate with T-SQL stored proce- 
dures changes the way developers approach application development in 
SQL Server 2005. 


DEVELOPING A SIMPLE SPATIAL APPLICATION USING CLR 
INTEGRATION 

In this session we show how to develop an application for buying and sell- 
ing cars using a SQL Server database, demonstrating how to use CLR inte- 
gration in the design of a spatially-aware database that allows for fast, 
geographically-sensitive queries. In doing so, we explore not only the con- 
cepts underlying such databases, but the technology used to implement, 
deploy, and debug them. 
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DATETIME RELATED PROBLEMS AND 
TEMPORAL QUERIES 
ITZIK BEN-GAN 


Datetime manipulation is in the heart of every 
database system. The datetime data type 
introduces many challenges due to different 
language and cultural conventions and due to 
the fact that to date there's no separation 
between date and time. This session will talk 
about the challenges involved with datetime 
manipulation and techniques to address those. 
The session will also discuss querying prob- 
lems related to temporal data including over- 
laps, grouping by week, and so on. 


CURSORS AND SETS 
ITZIK BEN-GAN 


BRIDGING THE GAP BETWEEN 


Many passionate debates revolve around 
whether cursors have a place in the database 
world. Cursors are often misused when the 
problem calls for a set-based querying solution. 
Misuse of cursors is often a result of lack of 
knowledge and experience of the relational 
model and set-based querying. Typically set- 
based solutions are simpler and more efficient 
than cursor-based solutions; however, there are 
types of problems for which cursor-based solu- 
tions outperform set-based ones. In this ses- 
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INTERMEDIATE AND ADVANCED T-SQL PROGRAMMING WITH SQL 
SERVER 2005 


This presentation will target intermediate and advanced SQL developers 
who have developed SQL/database applications with SQL Server T-SQL, 
Oracle PL/SQL, or others. It will focus on SQL Server 2005 and provide 
guidelines, best practices and tips on taking advantage of new T-SQL fea- 
tures to help such developers solve their database programming problems. 
We will also talk about T-SQL performance tuning with emphasis on the new 
tools available in SQL Server 2005. In addition, you will also be able to 
learn some tips on how to migrate some PL/SQL functionalities to T-SQL in 
SQL server 2005. 


BEST PRACTICES FOR DATA WAREHOUSING WITH SQL SERVER 2005 


This session will describe best practices for relational data warehousing 
with SQL Server 2005. First we'll set the stage by describing how you can 
use the SQL Server 2005 engine as a data warehouse, in coordination with 
transactional data sources, SQL Server Integration Services for ETL, SQL 
Server Reporting Services for reporting, and SQL Server Analysis Services 
for OLAP. Then we'll dive into how you can best support your data ware- 
house application on the SQL Server 2005 engine, including use of parti- 
tioning to manage the sliding window scenario for large fact tables, bulk 
loading and removal, management of statistics, index and indexed view 
design, writing queries to get good query plans, creating conditions to sup- 
port star join optimization, and recognizing star join plans. We'll also cover 
best practices with respect to managing a multi-user workload, hardware 
sizing and selection, and use of the scalable shared database technology 
for scale-out of a read-only database. 


WRITING SQL SERVER 2005 QUERIES THAT PERFORM BETTER 


Have you ever written a query that didn't perform as expected on SQL 
Server? Have you ever tried to tune an application after it was written, 
only to think "Why did they write it this way in the first place?" In this ses- 
sion we describe best practices, including dos and don'ts, for creating high 
performance databases and applications on SQL Server. We'll talk about 
designing a schema for good performance, creating good indexes, and 
designing queries that are easy to optimize and produce good query plans. 
We'll delve into some dirty details of the optimizer's cardinality estimation 
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sion you will learn why, in the majority of the 
cases, set-based solutions are the way to go, 
and what types of problems occur where cur- 
sors have better performance potential. This 
session will also introduce new language ele- 
ments introduced in SQL Server 2005 that help 
in bridging the gap between sets and cursors. 


UNDERSTANDING COMPILATIONS AND 
RECOMPILATIONS OF STORED 
PROCEDURES 

ITZIK BEN-GAN 

Programming stored procedures efficiently 
involves much more that just T-SQL coding 
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mechanisms to learn what queries are easy and not so easy for SQL Server 
to optimize. You'll leave with a better understanding of what makes a good 
database, query, and application for SQL Server 2005. 


ASYNCHRONOUS MESSAGING IN THE DATABASE 


Do you wish your triggers could defer some of their processing so that 
transactions run quickly? Would you like the SQL Server to launch batches 
periodically? Do you need to run queries or updates reliably without regard 
to computer and network failures? Would you like to collect data reliably 
from a large set of databases? How about reliably logging events such as 
altering a table? Is your client app accessing multiple SQL Server databas- 
es across multiple instances and you wish you could delegate this task to 
the server? Or do you simply like the idea of refactoring your app into 
loosely-coupled services? This session will present hands-on solutions to 
these problems using Service Broker, a platform that brings asynchronous 
messaging into the database world. 


CONCEPTS AND PRINCIPLES IN SQL SERVICE BROKER 


The introduction of Service Broker makes SQL Server 2005 a powerful plat- 
form for building asynchronous, distributed database applications. But it 
also introduces a new paradigm for architecting applications. This session 
explores how to think about services and conversations, how to strongly- 
type conversations using contracts and message types, and how to build 
services in T-SQL as well as the CLR. We will also discuss locking and con- 
currency, security, routing and transport. We recommend you attend “Do 
Mere Mortals Need Asynchronous Messaging in the Database” before this 
session although it is not required. 


TECHNIQUES FOR A RELATIVELY PAINLESS UPGRADE TO SQL 
SERVER 2005 


The new features of SQL Server 2005 are well worth the upgrade effort, but 
how do you upgrade your existing systems painlessly? This session drills 
into the necessary upgrade planning: preparing to upgrade, choosing the 
best upgrade strategy, and identifying incompatibility issues. You will learn 
tips and techniques on how to reduce your upgrade down time and how to 
best utilize the upgrade tools. The session has live demos of Upgrade 
Advisor and in-place upgrade features of SQL Server 2005. 
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INCREATING PRODUCTIVITY WITH SQL SERVER 2005 TOOLS 


One slide and all demos! Learn how the next generation tools in SQL Server 
2005 can increase your productivity. This session drills into the new fea- 
tures and demonstrates how to best leverage your efforts toward efficien- 
Cy. Learn tips and techniques for effectively using SQL Server and find out 
how these revolutionary tools can increase your productivity. This session 
features demos of SQLCMD, Management Studio, SQL Agent, Profiler/Replay, 
and Database Engine Tuning Advisor. 


DATABASE MAIL IN SQL SERVER 2005 


Using the new Database Mail feature of SQL Server 2005, you can send e- 
mail messages from SQL Server without installing Outlook or MAPI on your 
server. Database Mail is designed from the ground up as a high-end solu- 
tion to use SMTP for sending e-mails. Database Mail replaces the old SQL 
Mail and it is designed for reliability, scalability, security, and supportabili- 
ty. Throughout this session, you will learn how to configure, troubleshoot 
and use Database Mail in your applications effectively. 


LEVERAGING SQL SERVER "ALWAYS ON" TECHNOLOGIES TO 
REDUCE YOUR SYSTEM DOWNTIME 


Come learn how the "Always On" availability features included in SQL 
Server 2005 can improve the uptime of your application. 


INCORPORATING BUSINESS INTELLIGENCE IN APPLICATIONS 
USING SQL SERVER REPORTING SERVICES AND VISUAL STUDIO 


Microsoft SQL Server 2005 Reporting Services and Microsoft Visual Studio 
2005 have extended the ways in which developers can integrate and 
access Reporting Services functionality in their application. This session 
introduces you to the new features available in SQL Server 2005 Reporting 
Services, including the new report controls for the Microsoft Visual Studio 
development system that you can use in both Windows Forms and 
Microsoft ASP.NET applications. Learn how to integrate reports into your 
applications, and understand the advantages of control-only and server- 
based approaches. We demonstrate both of these control options, and 
build an application that displays reports without requiring a Reporting 
Services server. 
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skills. You need to understand the way SQL 
Server works in terms of reuse or non-reuse of 
previously cached execution plans. This session 
will describe the cases when SQL Server cannot 
reuse previously cached execution plans and 
therefore must recompile, and also cases when 
execution plans are reused when it's not effi- 
cient to do so. The session will explain how you 
can intervene in the process and when you 
should. The session will also introduce new fea- 
tures in SQL Server 2005 related to compila- 
tions, recompilations, and plan reuse that allow 
you greater control and better optimization of 
your stored procedures. 


SERVICE BROKER 
GERT DRAPERS 


2005 Service Broker. 


BATCHED AND ASYNC T-SQL USING 


Learn how to build batch and/or async-style 
applications inside SQL Server. Do you have a 
need for no-blocking stored procedures; do you 
want to kick off some process based on a state 
change inside the database; do you need to 
update another SQL Server without using a dis- 
tributed transaction? This session shows you 
how you can achieve this by using SQL Server 


SQL SERVER 2005 MEMORY INTERNALS 
GERT DRAPERS 


Where did my memory go? How is my memory 
being used? How can | find out which operation 
uses all the memory? This is just a small set 

of the questions that will be answered during 
this session. 


DATABASE UNIT TESTING 

GERT DRAPERS 

Learn how to create, execute, and deploy data- 
base unit tests using Visual Studio Team Edition 
for Database Professionals. This session will 
cover how you can validate the logic inside 
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your procedures, functions, and triggers; and 
have regression tests checking the outputs of 
your database schema preventing consuming 
applications to break. 


MANAGING SQL SERVER 
USING POWERSHELL 
GERT DRAPERS 


This session will show you how to manage your 
SQL Server environment using PowerShell in com- 
bination with SQL Server SMO. This powerful com- 
bination makes it possible to automate almost 
every SQL Server task through a simple script. 


THE 64-BIT QUESTION: WHICH PLATFORM? 
RICK HEIGES 


Why should | think about 64-bit now on SQL 
Server? What are some of the benefits that I 
can realize right now if | upgrade to 64-bit? Can 
| consolidate multiple servers to a single 64-bit 
server? How do | know it will work? What is the 
difference between IA64 and x64? This session 
will answer these questions as well as compare 
current and expected 64-bit offerings available 
in the workplace as we discuss 64-bit SQL 
Server 2000/2005. 


THE DYNAMIC DUO: VIEWS AND 
FUNCTIONS TO MAKE YOUR LIFE WITH 
SQL SERVER 2005 EASIER 

RICK HEIGES 


One of the newest features inside SQL Server 
2005 is the set of views and functions collec- 
tively known as DMVs. Learn how you can use 
these every day to make your job easier! We 
will explore how to use these separately and 
how you can create your own version of DMVs 
to help you to manage your environment. 


CONSOLIDATING SQL SERVER- 
STRATEGIES AND NOTES FROM THE FIELD 
RICK HEIGES 


Are you suffering from SQL Server sprawl? Do 
you have more servers than you know what to 
do with? What platform is best for consolida- 
tion? We'll address these questions and more 
during this informative session. Hear about 
real-world case studies about consolidation 
and the pros/cons of various approaches 
including virtualization. 


CONTINUOUS DATABASE INTEGRATION 
RICHARD HUNDHAUSEN 

Continuous Integration (CI) is a tenant of agile 
software development. Essentially, Cl checks 
out your code, performs a build, runs tests, 
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deploys, and generates reports/alerts-automat- 
ically when triggered by a change to the source 
code. Properly implemented, CI is almost like 
having an additional team member, working 
asynchronously in a back room, handling all of 
this drudgery, as you and your team continue 
working on other tasks. Now, imagine that 
you're working with database schemas, rather 
than code. Sound cool? Scary? Either way, 
Visual Studio Team Edition for Database 
Professionals enables this scenario, and this 
session will show you how. 


WRITING GOOD DATABASE UNIT TESTS 
RICHARD HUNDHAUSEN 


All developers should test their code. Most of 
us do, albeit in non-structured ways. Manual 
testing makes it difficult to run suites of regres- 
sion tests or smoke tests when you need to 
identify problems as requirements change. 
Traditionally, software developers have enjoyed 
frameworks provided by NUnit or Visual Studio 
Team System for writing, organizing, and run- 
ning these types of tests. With Visual Studio 
Team Edition for Database Professionals, sup- 
port for T-SQL unit testing will be provided, 
right alongside the existing support for .NET 
unit testing. In this session we'll explore the 
why, what, and most importantly the how to 
write good database unit tests. 


AGILE DATABASE DEVELOPMENT 
RICHARD HUNDHAUSEN 


You've probably heard the term "agile." It's a 
popular buzzword spoken by software develop- 
ment teams. Some strive to become more agile 
while others tend to avoid it, equating it to 
chaos. Either way, it's not something that has 
been applicable to database developers. With 
Visual Studio Team Edition for Database 
Professionals, this will change. This session will 
explore what it means to be agile and how 
those concepts might apply to database devel- 
opment and management, leaving you to make 
up your own mind if agile database develop- 
ment is for you. 


WHAT'S SO COMMON ABOUT COMMON 
TABLE EXPRESSIONS? 
DON KIELY 


In databases of the last millennium, recursive 
queries were a royal pain to implement, often 
requiring temporary tables, cursors, logic to 
control the flow, and a head full of hair to pull 
out while writing them. Yet recursive queries 
are the best way to go when you need to fit 
relational data into a hierarchical structure, 
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such as with organizational charts or 
object/subobject scenarios. Common Table 
Expressions (CTE) in SQL Server 2005 greatly 
simplify writing recursive queries, making it 
much easier to use this valuable technique in 
your code. During this session we'll explore how 
CTEs work, how to write them and use them in 
sophisticated recursive queries, what they are 
good for, and how to keep your full head of hair 
(if you arrive with one). 


LEARNING TO LOVE SQL SERVER 
2005 SECURITY 
DON KIELY 


There are few corporate assets as valuable in 
the information age as data. Enterprises spend 
billions to collect and generate it, slice and dice 
it in every conceivable way to mine market- 
place intelligence from it, and replicate and 
back it up using elaborate, redundant schemes. 
Yet it is all too common to slack on security. 
Sure, SQL Server 2005 is designed to be “secure 
by default,” but once you add databases and 
start letting users and their applications access 
the server you have already poked holes in the 
security. SQL Server comes with plenty of fea- 
tures that let you secure data, but it can be 
hard to get a handle on the right ones to use in 
your environment. During this session, we'll 
explore myriad security features in SQL Server 
2005 and how to put them to use in applica- 
tions. Both developers and administrators can 
benefit from learning how to use these tools to 
protect your data. 


UNLEASHING THE POWER OF TEMPDB 
DON KIELY 


The tempdb system database is one of those fea- 
tures of SQL Server 2005 that just doesn't get 
any respect. It's a hard working feature of every 
database server, yet often doesn't get the atten- 
tion it needs to be a healthy member of the 
database server ecosystem. In this session, we'll 
blow off the basics and look at how Microsoft 
beefed up tempdb in SQL Server 2005, explore 
management and troubleshooting to keep tem- 
pdb healthy, how to figure out space require- 
ments, and discuss some best practices to keep 
tempdb happy and smiling. 


ETL ARCHITECTURE DESIGN 
CONSIDERATIONS 

RUSHABH MEHTA 

This session will look at architectural 
considerations for designing an ETL process 
that meet the following goals when loading a 
data mart, including: 


* Robust and repeatable ETL 
architecture 


* Consistent end-to-end strategy 
* Reliable data 


* Automated error handling 
capabilities, which include restart 
capabilities and rollback mechanism 


* Better manageability of the ETL 
process 


10 COOL THINGS YOU CAN DO 
WITH DATA FLOW 
RUSHABH MEHTA 


One of the most exciting components of 
Integration Services is the Data Flow pipeline. 
This is where data processing and rich and 
complex transformations take place on the 
data. This demo-filled session will take you on 
a journey of some very cool things you can do 
with the data flow. This session is designed to 
allow you to witness the true power and capa- 
bilities of the Data Flow pipeline. 


MANAGEMENT AND DEPLOYMENT OF SSIS 
RUSHABH MEHTA 


The key to long-term success of SSIS-based sys- 
tems is a planned approach to configuration 
management and deployment. A carefully archi- 
tected approach can simplify the management 
of the many variables within an organization 
that affect the functioning of these packages. 
These variables include server name, database 
names, and file system, among others. 


In this session on management and deployment 
of SSIS, we will identify most of these variables 
that support our packages. Later we'll discuss 
strategies for managing these variables outside 
the packages. Then we will look at the function- 
ality that is available within SSIS to implement 
these configuration management options and 
discuss best practices on how to use this func- 
tionality. Finally, we will look at the different 
deployment options that are available in SSIS 
and see how to deploy these packages. 


Attendees will walk away with an in-depth 
understanding of the different configuration 
management and deployment options and the 
knowledge to make sound architectural judg- 
ments for future SSIS projects. 


PUTTING SOME ACTIONS INTO YOUR CUBE 
STACIA MISNER 


Is your Analysis Services 2005 cube the last 
stop for users in their quest for information? It 
doesn't have to be. In this session, you'll learn 
how to add actions that take a cube beyond the 


basics by displaying transactional details with 
drillthrough and by linking to internal reports, 
applications, or external Web sites. 


CREATING REPORTS WITH REPORTING 
SERVICES 2005 AND ANALYSIS 
SERVICES 2005 

STACIA MISNER 


With the introduction of Reporting Services 
2005, you now have a Query Designer to gener- 
ate the MDX required to retrieve data from a 
cube as a great first step, but you can extend 
this query to satisfy more complex reporting 
requirements. In this session, you'll learn sever- 
al tips and tricks about working with Analysis 
Services 2005 as a source for your reports, 
including how to customize an MDX query, how 
to handle aggregate values, and how to imple- 
ment cascading parameterized MDX queries. 


INTEGRATING SQL SERVER 2005 
BUSINESS INTELLIGENCE WITH OFFICE 
SHAREPOINT 2007 

STACIA MISNER 


Office SharePoint Server 2007 enables consoli- 
dation of your business intelligence applica- 
tions for easy access, analysis, and collabora- 
tion across the organization. Come to this ses- 
sion to learn how you can use Office SharePoint 
Server as a central location for administrators 
to organize and manage information assets and 
for information workers to locate, analyze, and 
personalize information available from Analysis 
Services, Reporting Services, and other sources. 


RECOVERING FROM ISOLATED 
DISASTERS AND HUMAN ERROR 
KIMBERLY L. TRIPP 


When data is inaccessible and something can't 
get done, the impact of this downtime can be 
costly-both in work loss and possibly lost cus- 
tomers. Could it have been avoided? First, it 
depends on what caused your system to be 
unavailable. Was it technology? Probably not! 
Most system downtime is caused by human 
error. OK, definitely NOT all, and yes, hardware 
fails. However, the most likely of hardware fail- 
ures are easily minimized through some form 
of relatively standard redundancy (i.e. RAID). 
But what happens when users incorrectly modi- 
fy the wrong data, or even worse, when some- 
one with higher privileges drops a table? While 
it seems like it would be easy to just restore 
that table, the problems are really larger than 
that. How was it possible to begin with? Could 
appropriate preventative features and tech- 
nologies have been used? Regardless, what do 
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you do now to recover with the least amount 
of additional downtime and data loss? How can 
you recover quickly and with the smallest 
impact to production? Come to this session to 
find out which technologies to use when and 
what to set up proactively to minimize the 
impact of or even avoid some of these prob- 
lems! Features discussed: Isolating Schema, DDL 
Triggers, Event Notifications, Agent Alerts, 
Partial Database Availability, Online Piecemeal 
Restore, and Database Snapshots. While some 
of these topics can also be used when hardware 
fails, this session will focus more on isolated 
failures and recovery. If you think that your sys- 
tem is safe from human error, you definitely 
need to be here! 


FOLLOW THE RABBIT: INTERACTIVE 


Q&A ON THE SE AND RE 
KIMBERLY L. TRIPP / PAUL RANDAL 


In this session, Kimberly Tripp and Paul Randal 
will have only 5-10 slides. Each slide will cover 
best practices and will then lead to a Q&A ses- 
sion where your questions drive our discus- 
sions. Paul will focus on the SE (Storage Engine) 
and internals and Kimberly will focus on the RE 
(Relational Engine) and query tuning/perform- 
ance. This session might not seem structured 
but it will be informative, focused, and fun! 


SESSIONS AND SPEAKERS 
ARE SUBJECT TO CHANGE. 


CHECK WEB SITE FOR UPDATES. 
www.DevConnections.com 
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IMPLEMENTING SQL EXPRESS 2005 SQL SERVER COMPACT EDITION- 
WILLIAM R. VAUGHN A NEW BEGINNING 

SQL Server 2005 Express has been knighted to WILLIAM R. VAUGHN 

replace the JET/Access database engine іп Based on Bill's first eBook, this session digs into 
many applications. Because SQL Express does the realities of Microsoft's newest SQL Mobile 
not behave like JET in many respects, it's tough reincarnation-SQL Server Compact Edition 

for developers to understand how to control it (SQLCe). We'll show every aspect of this SQL 
from their applications. This session discusses engine including where it fits in a comprehen- 
the differences in SQL Express over MSDE as sive data access solution. You'll learn how to 
well as JET, SQL Server Standard and Compact install SQLCe and most importantly, how to best 
Editions. You'll learn how to create SQL Express leverage its strengths. We'll explore how to 
instances, and how to configure it to support design applications that include SQLCe, build 
mixed-mode security as well as act as a shared SQLCe databases, as well as write queries for 
server engine. We'll also discuss and demon- it to process. We'll introduce the SQLCE 

strate how to install a database in SQL Express namespace that not only serves as a 

as well as start, backup, restore, and shut down query interface but is used to perform 

SQL Express using Framework classes. database maintenance and replication as 


well. This session is built for Visual Studio 
developers looking for an alternative 
stand-alone database. It walks through the 
process of managing all aspects of SQLCe 
databases using Visual Studio and SQL Server 
Management Studio. 


100% 


Technical Content! SESSIONS AND SPEAKERS 
Worth your time and investment! ARE SUBJECT TO CHANGE 


CHECK WEB SITE FOR UPDATES. 


www.DevConnections.com 


SQL SERVER WORLDWIDE USERS GROUP TRACK 


Б> MIGRATING SQL SERVER DTS PACKAGES = TROUBLESHOOTING 
TO SQL SERVER 2005 SQL SERVER-KNOWING 
WHERE TO LOOK IS HALF THE BATTLE 


Б> USING SQL SERVER 2005 REPORT BUILDER 
> COMPLIANCE AND SQL SERVER-BEST 
= DEPLOYING SQL SERVER 2005 PRACTICES TO BE READY FOR AN AUDIT 
REPORTING SERVICES 
= IMPORTING AND CLEANING DATA WITH DTS 


= DEPLOYING SQL SERVER 2005 SECURITY AND SQL SERVER 2000 
= DEPLOYING FAILOVER SOLUTIONS FOR = IMPORTING AND CLEANING DATA WITH DTS 
SQL SERVER 2000 AND 2005 AND SQL SERVER 2005 


8 + Register Today! Call 800-438-6720 * www.DevConnections.com 


A Lap Around the New Enhancements for Web Developers in Visual 
Studio “Orcas” 


ASP.NET AJAX Control Toolkit Unleashed: Creating Rich 
Client-Side Controls and Components 


Developing ASP.NET Web Applications with IronPython 
Developing Rich Web Applications with ASP.NET AJAX Extensions 
How to Integrate Expression Web into Your ASP.NET Development 
Introduction to WPF/E for ASP.NET Developers 


Tips and Tricks for Building Web Sites with 
Visual Studio 2005, ASP.NET 2.0 and IIS 7.0 


Tips and Tricks for Developers using ASP.NET AJAX 


Web Server Extensibility: Building IIS7 Modules to Enhance 
ASP.NET Web Applications 


Web Development on IIS 7.0: Integrating IIS 7.0 into the ASP.NET 
Web Development ProcessASP.NET 2.0 Security Controls 


ASP.NET AJAX Toolkit Overview 


ASP.NET and WCF: Building Secure, Reliable, and Interoperable 
Web Services 


ASP.NET Deep Dive 


ASP.NET Meets Windows CardSpace: A Better Login Experience for 
Your Users 


Asynchronous Features of ASP.NET 2.0 

Better Code Re-Use with N-Tier ASP.NET Applications 
Building Data-Driven Web Applications with LINO to SOL 
Building High Performance ASP.NET Applications 
Building Portal Applications with ASP.NET 2.0 Web Parts 
CodeSmith 4.0 Tips and Tricks 

Creating Custom Build Providers 

CSS 101: Moving Away from Table-based Layout 

Data Control Tips and Tricks 

Designing ASP.NET 2.0 Web Sites with Master Pages and Themes 
Do Application Design Patterns Make Sense in ASP.NET? 


Enhancing an Existing ASP.NET 2.0 Site using the Microsoft AJAX 
Framework (Atlas) 


ТЕТ for the Developer 

Improving .NET Application Performance and Scalability 

Is Your Web Site Legal? Accessibility for Visitors with Disabilities 
Microsoft AJAX, XML, and Web Services: How it all Fits Together 
Programming SOL Server 2005 Reporting Services 


Test-Driven Development and Continuous Integration for 
ASP.NET and VSTS 


Using Enterprise Library 2.0 in ASP.NET 
Visualizing Location Data using Mapping 
Web Control Data Binding 


Write Less Code by Using TableAdapters and Strongly 
Typed DataSets 


SESSIONS AND SPEAKERS 
ARE SUBJECT TO CHANGE. 


CHECK WEB SITE FOR UPDATES. 
www.DevConnections.com 
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ADO.NET “Orcas” Overview 
Best Practices with the .NET Event/Delegate Framework 


Building Next Generation User Experiences for Windows Client 
Applications Using Microsoft Expression 


Claims-Based and Federated Security with WCF 
Create Your Own Configuration Management System 
Cutting Edge Smart Client Applications 
Demand-load Add-in Frameworks 


Designing and Building Applications with Visual Studio Tools for the 
Office System (VSTO) 


Discoverability and the .NET Framework 

Effective Windows Presentation Foundation Design 

Encapsulate Business Processes with Custom WF Activities 

Exposing a Workflow as a (Web) Service 

From Zero to N-Tier in One Session Introduction to LINO 

Growing Your Business Using Office as a Development Platform 

Introducing Visual Studio 2005 Tools for the Microsoft 2007 
Office System 

Introduction to .NET 3.0 

| Want "My" Namespace 


Lego Mindstorms NXT Programming with Visual Studio and the 
Microsoft Robotics Studio 


LINO to SOL: Bringing SOL Code into Visual Studio 
Managed Preview Handlers for Vista and Outlook 
МЕТ Rocks! Live 

Programming RSS with Windows Vista and .NET 3.0 


Programming Windows Communication Foundation—A Developer's 
Primer 


Programming Windows WCF Operations and Calls 
Queue-based Applications Using SOL Server Service Broker 
Real World Deployment of .NET 3.0 Smart Client Applications 
Real World SOA Using WCF and WF 


Remote Mobile Communications Using WCF and .NET Compact 
Framework 3.0 


Revving up with Windows Presentation Foundation 
Smart Client: Introducing the Acropolis Application Framework 
Sneak Peak at Visual Studio: Code-named “Orcas” 


Software Factories and .NET: Domain Specific Languages in Practice 
for the Enterprise 


SOL Server Compact Edition and the Occasionally Connected Client 
SOL Server Schema Versioning and Database Builds 

Tracing and Logging in .NET 

Transactional Tasks in Windows Workflow Foundation 

Transactional WCF Services 

Understanding Efficient User Interface Design 

Visual Studio 2005 Team Foundation Server Planning and Deployment 
Visual Studio IDE—Beneath the Surface 


Visual Studio Tools for Applications: Next Generation Application 
Extensibility 


WCF Contract Design and Versioning Scenarios 

WCF Operations and Calls 

What Every Developer Should Know About Managing Application Identity 
What's New in Visual Basic 9.0? 

Windows Vista and .NET 

Windows Vista for Managed Developers: Beyond NetFx3 

Windows Vista Overview for Developers 

Windows Workflow—Giving Power Users Real Power 

WPF and Windows Forms Interoperability 


@ BONUS EVENTS J 


CONNECTIONS 


Aggregate This! Developing Rollup Web Parts for WSS and MOSS 
All About Web Parts: Building Pluggable Components for SharePoint 


Branding Your Microsoft Office SharePoint Server 2007 Sites Using 
Site Definitions and Features 


Branding Your Microsoft Office SharePoint Server 2007 Sites- 
The Basics 


Building a Better Admin Experience—A Dive into Admin Tool 
Development Options 


Building a Better Custom List: A Dive into List-Based Development 
Create an Internet-Facing SharePoint Site 
Creating a Client Extranet with Windows SharePoint Services 3.0 


Creating an Internet Presence with Microsoft Office SharePoint 
Server 2007 


CSS Can Be Your Friend: A Developer's Guide to Using Styles in 
SharePoint 


Custom Authentication for SharePoint 


Developing Social Computing and "Enterprise 2.0" Applications 
with Microsoft Office SharePoint Server 


Empowering Power Users with Custom Activities in the 
Workflow Designer 


Essential Windows Workflow Foundation for Developers 


Exploring the New Microsoft Forefront Server Security 
for SharePoint 


Groove 2007 and Windows SharePoint Services 3.0: Better Together 


Integrate Smart Client and Windows Forms Applications with 
SharePoint Sites and the Business Data Catalog 


Integrating Windows Rights Management Services with 
SharePoint 2007 


Microsoft Office SharePoint Server 2007: A Viable Replacement for 
Exchange Public Folders? 


Office Live: A Solution Developer's Perspective 
Programming SharePoint with ASP.NET AJAX Extensions 
Quick Integration from SharePoint to Your Application 


SharePoint Taxonomy: How to Map Out and Plan Your 
MOSS 2007 Site 


SharePoint User Adoption: Manage and Train Your Information 
Workers 


SOL Database Considerations for SharePoint 2007 
Using SharePoint to Schedule Jobs 


Use the Visual Studio Extensions for Windows SharePoint Services 
to Create Custom Site Definitions and a Whole Lot More! 
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PRE-CONFERENCE WORKSHOP - 


INSIDE T-SQL QUERYING, PROGRAMMING AND TUNING-PUTTING 
YOUR KNOWLEDGE INTO ACTION 


9AM - 4PM * SQLSERVER TRACK 


ITZIK BEN-GAN 

This workshop is jam-packed with practical advice for T-SQL querying, pro- 
gramming and tuning. The seminar covers practical problems T-SQL program- 
mers face daily, providing different solutions for each problem, and explains 
in detail how to tune your code to produce robust and efficient applications. 
Among the subjects that will be covered: ranking calculations, window-based 
calculations, islands and gaps, running aggregations, custom aggregations, 
PIVOT on steroids, unpivoting, auxiliary table of numbers, splitting arrays, TOP 
on steroids, APPLY, paging, randomization, maintaining sequences, graphs, 
trees, hierarchies and recursive queries, T-SQL vs. CLR routines, regular 
expressions, dynamic filters, exception handling, and more... 


PRE-CONFERENCE WORKSHOP • 9AM - 4PM * SQL SERVER TRACK 


SQL SERVER 2005: TIPS AND TRICKS TO TUNING FOR HIGH 
PERFORMANCE 


KIMBERLY L. TRIPP 


Come to this full-day, fast-paced, advanced workshop to go through different 
methodologies to find problems and a variety of “short hand” versions to 
solve them. Some of the things we'll cover are: using DTA as a true "Advisor" 
and knowing how to choose what to implement and what's going to give you 
the biggest bang for the buck, statement-level recompilation vs. modulariza- 
tion of stored procedures (BOTH can be useful but when?); advanced indexing 
strategies (indexing for AND, OR, Joins, Aggregates, ORDER BY); and just gen- 
eral "where do | start" and “what should | try" tips including: evaluating dif- 
ferent aspects of statistics, creating additional statistics, re-writing queries, 
and more! Not a session for newbies, but if you've struggled with stored pro- 
cedure performance, poor query performance, and general application slow- 
downs, this is the place to be! 


PRE-CONFERENCE WORKSHOP • 9AM - АРМ * ASP.NET TRACK 


HANDS-ON ASP.NET 2.0 AND VISUAL STUDIO 2005: 
BRING YOUR OWN LAPTOP 


PAUL LITWIN 


This workshop provides a jumpstart to using Visual Studio 2005 to create 
ASP.NET 2.0 Web sites. Using Visual Studio 2005 you'll learn how to get started 
creating Web sites that sing. Covered topics will include Master Pages, site maps 
and the navigation controls, data enhancements, including the DataSource, 
GridView, FormView, DetailsView controls, and security enhancements, including 
the multitude of new security controls. See Web site for requirements. 


PRE-CONFERENCE WORKSHOP • 9AM - 4PM * ASP.NET TRACK 
MOVING FROM ASP.NET TO AJAX: DESIGN 

AND BUSINESS CHOICES 

DINO ESPOSITO 


The primary purpose of ASP.NET AJAX is making the user's experience as rich 
as possible by providing a breakthrough programming environment to devel- 
opers so that they can code what was impossible or impractical before. 
Partial page refresh and remote method calls are the key features of an 
AJAX-powered application. Together, these features enable developers to 
build mash-up applications, display real-time data, and update the user inter- 
face promptly and smoothly. What's the best way to move your application to 
AJAX? Should you just go with low-level ASP.NET AJAX controls such as the 
UpdatePanel control or would you be better adopting a third-party suite of 
controls? Read more about this workshop online. 


PRE-CONFERENCE WORKSHOP • 9AM - 4PM * VISUAL STUDIO & NET TRACK 
WPF-A SCENARIO-BASED APPROACH 
BILLY HOLLIS 


This workshop covers several of the most typical scenarios for WPF, including 
a wide range from a supplement to typical Web-based systems through a line- 
of-business application with more interactive UI, and up to an advanced 
media/graphics system using advanced 3D capabilities. We'll start by dis- 
cussing basic WPF concepts, with the assumption that the audience has not 
been exposed to WPF. Then, for each application scenario, the major tech- 
nologies in WPF that make it a good choice are covered, and then a sample 
application that meets the scenario is shown and analyzed. 


PRE-CONFERENCE WORKSHOP • 9AM - 4PM * VISUAL STUDIO & .NET TRACK 


.NET TECHNOLOGY ROAD MAP: WHERE THE HECK ARE WE 
NOW...AND WHERE DO WE GO FROM HERE? 


MICHELE LEROUX BUSTAMANTE 


With these rapidly changing times, developers have a lot more on their minds 
and on their plates than they did at any point in recent time. Although the 
Visual Studio and the .NET Framework both provide tools that yield an overall 
increase in productivity during the development cycle, the avalanche of tech- 
nologies that builds upon these foundations can seem overwhelming if not 
insurmountable at times. This workshop will take you through a guided tour 
of the Microsoft technologies available today, tomorrow, and into the foresee- 
able future...and enable educated decisions on aligning your product road 
map with upcoming technologies. We'll discuss language and platform trends 
for .NET 2.0, .NET 3.0, and beyond; designing the data access layer with 
ADO.NET 2.0, ADO.NET “Orcas,” LINQ, ООМО, and XLINQ; approaches in Windows 
development with Windows Forms, ClickOnce, and WPF; essentials for ASP.NET 
Web development and the relevance of AJAX; communication stacks like 
Remoting, Enterprise Services, ASMX, and their future applicability now that 
WCF is here; directions in development tools from Visual Studio 2005 and 
Visual Studio Team System to Orcas; new Expression designer tools; hosting 
and platform directions from IIS 6.0/Windows Server 2003 to IIS 7/Windows 
"Longhorn" Server; and the significance of XP/SP2 and Windows Vista to 
application consumers. In this intense, one-day briefing, you will see numer- 
ous demonstrations of these technologies, we will assess the benefits and 
advantages of the forward trends and you will gain an overall picture of each 
technology's place in your development efforts today and tomorrow-for each 
respective discipline. 


PRE-CONFERENCE WORKSHOP • 9AM - 4PM * SHAREPOINT TRACK 


SURVIVING THE FIRE: UPGRADING FROM SHAREPOINT PORTAL 
SERVER 2003 TO SHAREPOINT SERVER 2007 


BILL ENGLISH 


This day-long workshop for SharePoint architects, project managers, and 
SharePoint administrators will demonstrate live and in-person how to take a 
medium server farm in SharePoint Portal Server 2003 and upgrade that farm 
to a fully functioning SharePoint Server 2007 farm. You will see the farm 
upgraded live as we go through all of the decision points and "gotchas" that 
you'll need to consider before you do your own upgrade. If you have to do a 
Portal server upgrade in the next 12 months, this workshop is one that you 
cannot afford to miss. 


NOTE: LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS • THE COST 
OF A WORKSHOP IS IN ADDITION TO THE REGULAR CONFERENCE FEE. 
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THURSDAY MARCH 29, 2007 240: POST-CONFERENCE WORKSHOPS 
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POST-CONFERENCE WORKSHOP • АМ - 4РМ + SQL SERVER TRACK 


CRUCIAL DATABASE MAINTENANCE TECHNIQUES 

FOR DATABASES OF ALL SIZES 

KIMBERLY L. TRIPP AND PAUL RANDAL 

Often databases are designed to handle complex business logic and to hold criti- 
cal data. Once built, they're put into production and often perform well.. for a 
while. When the load increases and the data volume becomes larger and larger, 
performance degrades and problems ensue. What can be done to ensure smooth 
operations? How can you minimize data loss in the event of a disaster? What are 
the most crucial maintenance operations to automate, how do they work and 
why are they important, what are the best practices for running them, and how 
can you ensure they're working correctly? Maintenance is the key to having a 
System that's healthy, recoverable, and performs well. There are lots of areas to 
cover but here are the most important features: Database files (shrink, grow, vir- 
tual log files, log size/management), consistency checks (CHECKDB) v. CHECK- 
TABLE/CHECKALLOC/CHECKCATALOG (why might you want to break down your 
checks?), fragmentation (Defrags v. Rebuilds), Statistics (create and update), and 
Backup/Restore (recovery models, options/granularity, strategies). This workshop 
is targeting the best practices and goals for database administrators who are 
wearing many hats or full-time system administrators. The workshop will vary 
from 200-400 level covering ALL of the key concepts of what the feature is, how 
it works, why it's important, and best practices in how and when to run. 


POST-CONFERENCE WORKSHOP • 9AM - 4PM + ASP.NET TRACK 

ASP.NET SECURITY FROM FRONT TO BACK 

DON KIELY 

Securing Web applications is more important than ever, as new and clever 
attacks explore every weak spot in the Web server and its applications. New 
technologies like AJAX expand the attack surface well beyond traditional Web 
applications, and in the rush to deploy, security can easily be forgotten. 
ASP.NET 2.0 and evolving technologies provide many features you can use to 
secure your applications, providing a rich infrastructure that saves develop- 
ers the work of developing custom security solutions for every new applica- 
tion. But simply implementing a feature isn't enough if you don't understand 
the implications of using the feature and how it interacts with others in the 
application. You can all too easily open more security holes than you close. 
We'll spend the day looking at Web and ASP.NET security from front to back 
and back to front, exploring the security features you can build into the inter- 
face for authentication and authorization and reduce exposure to modern 
attacks, and then back through the security features built into the .NET 
Framework and using IIS effectively to support secure applications. Along the 
way, you'll learn how to effectively (and why you must) implement partially 
trusted Web applications, protect against various injection attacks, monitor 
the security health of your applications, and many others. This session isn't 
for you if you're new to ASP.NET 2.0, but if you have a few applications under 
your belt you'll learn how to protect them, your users, and your servers from 
modern attacks. And from well-intentioned users! 


WORKSHOPS AND SPEAKERS 
ARE SUBJECT TO CHANGE. 
SEE WEB SITE FOR THE MOST CURRENT 
DESCRIPTION AND AVAILABILITY. 


www.DevConnections.com 


NOTE: LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS + THE COST 
OF A WORKSHOP IS IN ADDITION TO THE REGULAR CONFERENCE FEE. 


POST-CONFERENCE WORKSHOP * 9AM - 4PM * VISUAL STUDIO & .NET TRACK 
WCF-BEYOND THE ENDPOINTS 

JUVAL LOWY 

Windows Communication Framework (WCF) is the .NET runtime for developing, 
deploying, and consuming service-oriented applications. The service model 
offers a simple yet amazingly capable programming model. This comprehen- 
sive tutorial starts by introducing the basic motivation for service-oriented 
applications and their operating principals and concepts. It then dives into 
the essentials of WCF: services, clients, contracts, and end points, discusses 
hosting options, and shows how to build and deploy WCF services, as well as 
presenting the WCF architecture and its implications on the programming 
model. Then you will see other concepts at work such as data contracts, 
instance management, operations, callbacks, and transactions. After attend- 
ing this workshop you will be able to start programming and exploring WCF. 
Don't miss this unique opportunity to learn WCF from Juval Lowy who has 
been part of the strategic design effort for WCF from the beginning, and who 
offers a profound insight into the technology and its applications. 


POST-CONFERENCE WORKSHOP - 
WORKFLOW IN ACTION 
KATHLEEN DOLLARD 
You've heard tons about Windows Workflow Foundation, but no one's really 
shown you how to implement it for your applications. This workshop starts 
with an overview of what Windows Workflow is and why it's likely to become a 
key part of your development strategy. Then you'll watch the creation of a 
complex workflow integrating human and computer based actions. This work- 
flow includes both standard Windows Workflow tasks and custom tasks. Some 
of these tasks will integrate other workflows, letting you merge sequential and 
state machine workflows. You'll see rule-based decisions and interactions with 
things outside the workflow-including how to implement data exchange serv- 
ices, access Web services, wait for human input, and respond when actions fail 
to occur. With the workflow ready to go, it's time to work out hosting, debug- 
ging, tracing, and exception management. Solving these challenges provides a 
functioning workflow that offers a pattern and many details you can draw on 
to implement your own workflow application. But before you can implement 
your workflows, you must design them. Workflow design presents new chal- 
lenges to developers, particularly since you can share this design experience 
with power end users-actually letting them design portions of the workflow. In 
this workshop, you'll learn how to recognize good workflow candidates, make 
decisions on workflow granularity, determine how to share design responsibili- 
ties, and implement workflow details. 


9AM - 4PM * VISUAL STUDIO & .NET TRACK 


POST-CONFERENCE WORKSHOP * 9AM - 4PM * SHAREPOINT TRACK 
DESIGNING AND IMPLEMENTING SHAREPOINT 2007 SOLUTIONS 
TED PATTISON 

Windows SharePoint Services 3.0 (WSS) is first-class development platform. 
This full-day workshop presents a bottom-up view of WSS platform architec- 
ture and introduces the essential building blocks used to construct business 
solutions. The workshop begins by showing you how to create, install, acti- 
vate, and debug a feature. The workshop will then step through how to build 
out a custom business solution using application pages, site pages, user con- 
trols, Web Parts, Master Pages, and custom cascading style sheets. The work- 
shop will also discuss creating custom list definitions and custom content 
types as well as how to create and bind custom event handlers. The workshop. 
will conclude by showing you how to create solution packages to provide a 
distribution mechanism to deploy your custom solutions in a staging environ- 
ment or a production environment. 


March 25-28, 2007. ORLANDO, FLORIDA • 11 


NOVEMBER 5-8, 2007 LAS VEGAS, NV 


Join us at the cutting-edge 
event for developers and DBAs 
this Fall in Las Vegas, Nevada! 


Connections raises the bar for 
IT Conferences, delivering: 


EXPERT SPEAKERS 
UNPARALLELED WORKSHOPS 


CONNECTIONS DYNAMIC CONTENT 
HOT LOCATION 


TAa emm 


CONNECTIONS Mandalay Bay Resort and Casino 


= Co-located with 
Share Point Microsoft Exchange Connections 


CONNECTIONS 


Windows Connections 
Office Connections 


— | 
dirmi ERE een 


— iy A full membership to 
SSWUG.ORG, the Three Lunches 


SQL Server Worldwide User's Group Help Three Continental Breakfasts 
Center site. The site includes 100s of scripts, Reception 
di ion board ticl Я m Conference T-Shirt and Bag 
iscussion boards, articles, reviews, e-mai Soe 
discussions, and more. Proceedings Resource CD 
.. and more 


12 * Register Today! Call 800-438-6720 • www.DevConnections.com 


SPEAKERS ARE SUBJECT TO CHANGE. SEE WEB SITE FOR UPDATES AND BIOS. 


PME Bi a 


DAN APPLEMAN TODD BAGINSKI ITZIK BEN-GAN DARRIN BISHOP MIGUEL CASTRO GERT DRAPERS KATHLEEN MARKUS EGGER 
DESAWARE, INC. SHAREPOINT EXPERTS SOLID QUALITY LRS IT SOLUTIONS STEELBLUE MICROSOFT DOLLARD EPS SOFTWARE 
LEARNING SOLUTIONS GENDOTNET 
; E] 
Е ш А A 
BILL ENGLISH DINO ESPOSITO CARL FRANKLIN SCOTT GUTHRIE RICK HEIGES SCOTT HILLIER MICHAEL BILLY HOLLIS 
MINDSHARP SOLID QUALITY FRANKLINS.NET MICROSOFT SCALABILITY EXPERTS MICROSOFT HERMAN AUTHOR 
LEARNING petrus PARALLELSPACE 
CONFERENCE CO-CHAIR CORPORATION 
9. 
à | | 5 2 
ALEX HOMER ROB HOWARD TIM HUCKABY RICHARD DON KIELY NICKOLAS LANDRY DANIEL LARSON JULIA LERMAN 
STONEBROOM LTD. TELLIGENTSYSTEMS INTERKNOWLOGY HUNDHAUSEN SENIOR TECHNOLOGY INFUSION DEVELOPMENT NEWSGATOR THE DATA FARM 
ACCENTIENT CONSULTANT TECHNOLOGIES INC. 


MICHELE PAUL LITWIN JUVAL LOWY EMER MCKENNA RUSHABH MARK MILLER STACIA MISNER BRIAN MORAN 
LEROUX SUELE TRAINING IDESIGN, INC. MEHTA DEVELOPER EXPRESS SOLID QUALITY SOLD QUALITY LEARNING 
BUSTAMANTE CONNECTIONS E NE. LEARNING CONNECTIONS 
bd CONFERENCE CHAIR CONFERENCE CO-CHAIR CONFERENCE CHAIR 
MICHAEL NOEL BRIAN NOYES TOM RIZZO PAUL D. SHERIFF STEVEN SMITH PRASHANT DAVE SUSSMAN STEPHEN TOUB 
CONVERGENT IDESIGN, INC. MICROSOFT PDSA, INC. ASPALLIANCE.COM SRIDHARAN CONSULTANT MICROSOFT 
COMPUTING РАНЕЕ ее MICROSOFT 
KIMBERLY L. WILLIAM R. AMI VORA DAN WAHLIN STEPHEN 
TRIPP VAUGHN MICROSOFT WAHLIN CONSULTING WALTHER 


SQLSKILLS.COM BETA V CORPORATION SUPEREXPERT 


SEE WEB SITE FOR UPDATED SPEAKERS AND SESSIONS. 


March 25-28, 2007 * ORLANDO, FLORIDA * 13 


GENERAL INFORMATION Ө] 


Vets 2X Бр LP 


TAX DEDUCTION 


Your attendance to a 
DevConnections conference 

may be tax deductible. Visit 
www.irs.ustreas.gov. Look for topic 
513 - Educational Expenses. You 
may be able to deduct the confer- 
ence fee if you undertake to (1) 
maintain or improve skills required 
in your present job; (2) fulfill an 
employment condition mandated 
by your employer to keep your 
salary, status, or job. 


GROUP DISCOUNT 
Register individuals from one 


company at the same time and 
receive a group discount. 


ORLANDO WORLD CENTER MARRIOTT, ORLANDO, FLORIDA 


1-3 registrants $1,395 per person 
Additional registrants | $1,195 per person 
after the 3rd ($200 off each) 
(4th, 5th, 6th...) 


Call 800-438-6720 to take 
advantage of group 
discount pricing. 


ORLANDO WORLD CENTER MARRIOTT 


HOTEL ACCOMMODATIONS 
The Orlando World Center Marriott, 8701 World Center Drive 
Orlando, Florida 32821, is the conference site and host hotel. 
SPACE IS LIMITED so reserve your room early by calling the 
conference hotline at 800-438-6720 or 203-268-3204. 


Please call Pericas Travel at 203-562-6668 for airline reservations. 


Meeting Desk at 800-654-2240 for reservations and refer to code 
CV# 010ROO3O0 to receive your attendee discount. 


Mears Transportation is the designated ground carrier at Orlando 
International Airport. The shuttle may be picked up at Level 1 of the air- 
port. The shuttle is available 24 hours a day. You may call Mears 
directly at 407-843-2404 for more information or go to their Web 


site www.mearstransportation.com. 


Come early or stay late. Bring the family! You are in the land of fantasy 
for children of all ages. Walt Disney World - Magic Kingdom? Park, 
Disney MGM Studios®, Epcot® and Disney's Animal Kingdom? Theme 
Park. In addition, explore Kennedy Space Center, Sea World, and 
Universal Studios Theme Park, or take a short drive to beautiful 
white-sand Atlantic beaches. 


Ai! | RE 
The recommended dress for the conference is casual and comfortable. 
Please bring along a sweater or jacket, as the ballrooms can get cool 
with the hotel's air conditioning. 


SPONSORSAIP/EA IT INFORMATION 
For sponsorship information, contact: Rod Dunlap 
phone: 480-917-3527 * e-mail: rod@devconnections.com 
See Web site for more details. www.DevConnections.com 
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CONFERENCE REGISTRATION * MARCH 25-28, 2007 ОНЫНЕ 


www.DevConnections.com 


FULL CONFERENCE REGISTRATION INCLUDES KEYNOTE ON MARCH 25TH, 6:30PM, E-MAIL 


THROUGH CLOSING SESSION MARCH 28TH, 4:30PM Е a 


(800) 438-6720 * (203) 268-3204 


FAX 
NAME PRIORITY CODE (203) 261-3884 

MAIL 
COMPANY TITLE SQL Server Connections 2007 
c/o Tech Conferences, Inc. 
731 Main Street, Suite C-3 


STREET ADDRESS (REQUIRED TO SHIP MATERIALS) Monroe, CT 06468 

CITY, STATE, POSTAL CODE COUNTRY 

TELEPHONE FAX E-MAIL ADDRESS (IMPORTANT) 

Q SQL Server Connections ............... eese on or before February 1, 2007...................... $1295 
—————————————————Á after February 2, 2007................................$1395 


PRE-CONFERENCE WORKSHOPS SUNDAY, MARCH 25, 2007 LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS. 


О 9:00AM - 4:00PM Inside T-SQL Querying, Programming and Tuning- 
Putting Your Knowledge into Action BEN-GAN uc... csssssesesecssesesscesssssesessssssessessessssceeees $399 
C) 9:00AM - 4:00PM SQL Server 2005: Tips and Tricks to Tuning for High Performance  TRIPP............ $399 
C) 9:00AM - 4:00PM Hands-On ASP.NET 2.0 and Visual Studio 2005 LWN ............................ sns 
ШО 9:00AM - 4:00PM Moving from ASP.NET to AJAX: Design and Business Choices 
О 9:00AM - 4:00PM WPF-A Scenario-Based Approach НОШ$............................. 
C) 9:00AM - 4:00PM .NET Technology Road Map: Where the Heck Are We Now... 
and Where Do We Go from Here? BUSTAMANTE ........s.scsscecsscsssscessecscecsssessesesstensceeuseeceesecee $399 
О 9:00AM - 4:00PM Surviving the Fire: Upgrading from SharePoint Portal Server 2003 
to:SharePoirit-Server:2007 ENOLISHL.... assert tritt teet restet et $399 
POST-CONFERENCE WORKSHOPS THURSDAY, MARCH 29, 2007 LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS. 
О 9:00AM - 4:00PM ASP.NET Security from Front to Back KIE sess eere $399 
C) 9:00AM - 4:00PM WCF-Beyond the Endpoints LOWY 
C) 9:00AM - 4:00PM Workflow in Action DOLLARD 
C) 9:00AM - 4:00PM Database Maintenance  TRIPP/RANDAL 
C) 9:00AM - 4:00PM Designing and Implementing SharePoint 2007 Solutions РАТТІЅ0М............................ $399 


The cost of a workshop is in addition to the regular conference fee. 


CONFERENCE MATERIALS 


Full conference registration includes materials for the one conference for which you register. 
You may purchase materials for the other concurrently run events. 


О Microsoft ASP.NET Connections Proceedings CD sssini n i $75 
О Visual Studio & .NET Connections Proceedings CD ................ eese entente tnn tn tenta tn tete ННН $75 
LX SharePoint Connections Proceedings CD sssrinin riir E S RE e $75 


PAYMENT TOTAL 


*IMPORTANT: You must reference SQL Server Connections on your check. 


Q CHECK (payable to Tech Conferences) All payments must be in US Currency. Checks must be drawn on a US bank. 
Ц VISA C MASTERCARD ИЦ) AMEX 
CREDIT CARD NO. EXPIRATION DATE 


Cardholder's Signature Cardholder's Name (print) 


Notes & Policies: The Conference Producers reserve the right to cancel the conference by refunding the registration fee. Producers can substitute speakers and topics and cancel sessions without notice or obligation. 
Updates will be posted on our Web site at www.DevConnections.com. Tape recording, photography is not allowed at any session. Conference producers will be taking candid pictures of events and reserve the right to 
reproduce. By attending this conference you agree to this policy. You may transfer this registration to a colleague. Please inform us if you have any special needs or dietary restrictions when you register. Microsoft 
ASP.NET and Visual Studio Connections attendees will receive a one-year subscription to MSDN Magazine. Current subscribers will have an additional year added to their subscription. This offer is available to U.S. regis- 
trants only. $22.50 of the funds will be allocated toward a subscription to MSDN Magazine (a $45.00 value). This is not an additional expense and subtraction from prices listed is not permissible. The conference registra- 
tion includes a 6-month print subscription to SQL Server Magazine. Current subscribers will have an additional 6 months added to their subscription. Subscriptions outside of the United Sates and Canada will be digital. $6.25 
of the funds will be allocated toward a subscription to SQL Server Magazine ($25.00 value). Registration & Cancellation Policy: Registrations are not confirmed until payment is received. Cancellations before February 26, 
2007 must be received in writing and will be refunded minus a $100 processing fee. After February 26, 2007, cancellations and no shows are liable for full registration, it can be transferred to the next DevConnections 
Conference within 12 months or to another person. Microsoft, Microsoft .NET, Visual Basic „МЕТ, C#, Microsoft SQL Server, MSDN, WinFX, and Windows are either trademarks or registered trademarks of Microsoft Corporation. 
All other trademarks are property of their owners. 
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T-SQL Black Belt 


DATETIME 
Calculations, Part 1 


Trimming techniques help you return 
only the date or the time of a given 
datetime value 


D 


Server Magazine’s editors and authors brainstorm about subjects that we should cover 


atetime calculations are at the heart of many databases. Every day, programmers face 
challenges related to the manipulation of datetime data. Nearly every time SQL 


in the magazine, we agree about the need to cover datetume-related subjects simply 
because they're so practical. With that in mind, Га like to begin a series of articles in 
which I discuss datetime challenges and calculations. This 
month, I focus on trimming techniques—that is, returning 
only the date or the time of a given datetime value. 


Datetime Storage Formal 

One of the most common challenges in working with datetime datatypes (e.g., DATE- 
TIME, SMALLDATETIME) in SQL Server is that there’s no separation between date 
and time. But, of course, you often have the need to store just dates or just times. Storing 
your dates and times in datetime datatypes has several advantages over storing them in 
other datatypes (e.g., character strings): You get inherent integrity enforcement (i.e., invalid 
values are rejected), and you can use the datetime functions in your calculations. 

When you need to store only dates or only times, the trick is to trim the part you don’t 
need. However, because the datetime datatypes include both a date and a time portion, 
you wont actually be trimming; rather, in practice, you'll be zeroing the irrelevant part. 
The storage format that SQL Server uses internally to represent datetime values is two 
4-byte integers for DATETIME and two 2-byte integers for SMALLDATETIME. One 
integer is an offset in terms of days from the base date January 1, 1900, and the other is an 
offset from midnight (in terms of clockticks for DATETIME—in which one clocktick is 
3!/3 milliseconds—and in terms of minutes for SMALLDATETIME).When you need to 
store only dates, you'll store a date at midnight; technically, you'll “zero” the time portion 
of the datatime value. Knowing that the time portion is always midnight in the values 
youre manipulating, you can simply ignore it. By doing so, you'll be able to easily work 
with dates. 

Notice what you get when you convert a character string containing only a string 
representation of a date to DATETIME: 


SELECT CAST('20070212' AS DATETIME); 


You get the output 2007-02-12 00:00:00.000. SQL Server assumes midnight as the time 
value. Internally, it stored 0 as the integer representing the offset from midnight. Assuming 
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you specify dates with midnight in the 
time portion when you store them in a 
DATETIME column called date_col in a 
table, when you want to filter rows with a 
certain date (e.g., February 12, 2007) you'll 
use the filter 


WHERE date_col = '20070212' 


The column name date_col that appears to 
the left of the equals sign is а DATETIME, 
and the literal (i.e., constant) to the right 
of the equals sign is a character string (1.е., 
VARCHAR) that contains only a date. 
DATETIME has a higher datatype prece- 
dence than VARCHAR, so SQL Server 
will implicitly convert the VARCHAR 
value to DATETIME. Because no time 
component was specified in the literal, 
SQL Server will assume midnight as the 
time component, and thus there’s basis for 
comparing date_col to a character string 
that contains only the date component. 
Similarly, if you want to store only times, 
you can zero the integer that represents the 
offset from the base date; in other words, 
you store the times with the base date. 
Notice what you get when you convert a 
character string that contains only a time 
to DATETIME: 


SELECT CAST('01:23:43.210' 
DATETIME); 


You get the output 1900-01-01 
01:23:43.210. SQL Server assumes the 
base date as the date value. Internally, 
it stored 0 as the integer representing 
the offset from the base date. Assuming 
you stored times with the base date in a 
DATETIME column called time_col in a 
table, when you want to filter rows with 
a certain time (e.g., 01:23:43.210), you'll 
use the filter 
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WHERE time col = '@1:23:43.210' 


Again, SQL Server will implicitly convert the 
literal that appears to the right of the equals 
sign to DATETIME assuming the base date, 
and thus the values are comparable. 


Extracting Date Only 
Now that you understand the storage format 
of datetime datatypes and the fact that date 
and time are technically inseparable, you can 
start handling common calculation needs. 
Suppose you need to extract only the date 
portion from a datetime value—for example, 
GETDATE(, which returns the system’s 
datetime. You need to produce a datetime 
value with the input date at midnight. 

You can perform this calculation in three 
ways. In the first technique 


SELECT CAST( 
CONVERTCCHARC8), GETDATE(), 
112) -- 'YYYYMMDD' 
AS DATETIME); 


the CONVERT function converts the 
input datetime value to a character string 
using style 112 (YYYYMMDD). This style 
extracts only the date portion from the input 
value. The CAST function converts the date 
character string back to DATETIME. When 
a character string expressed in this format is 
converted to a datetime datatype, its inde- 
pendent of any language- or date-related 
settings that are in effect for your session. 

The second technique that lets you set the 
time portion to midnight is to convert the 
input datetime value to an integer, subtract 
0.50000004, and convert the result back to 
datetime: 


SELECT CASTCCASTCGETDATEO- 
0.50000004 AS INT) AS 
DATETIME); 


When a datetime value is converted to an 
integer, SQL Server returns the offset in terms 
of days from the base date; the time portion 
is rounded down to 0 days if its smaller than 
or equal to 11:59:59.993 and otherwise up to 
one day. By subtracting 0.50000004 portion 
of a day from the input datetime value, you 
compensate for cases in which the time por- 
tion is later than 11:59:59.993, in which case 


Solution to January’s Puzzle: Crossing the Tunnel 

Four people—let’s call them persons A, B, C, and D—need to cross a dark tunnel. 
Only two people at a time can cross the tunnel, and because the tunnel is very 
dark, a flashlight is mandatory. Person A can cross the tunnel in 1 minute, person 
B can cross in 2 minutes, person C can cross in 4 minutes, and person D can make 
it in 5 minutes. The group has one flashlight, containing batteries that last only 12 
minutes. What strategy will enable all members of the group to cross to the other 
side in 12 minutes before the flashlight’s batteries run down? 

Most people try to solve this puzzle by letting person A walk from start to 
end with each of the others, then walk back alone to pair with the next person. 
Intuition says that this approach must be the fastest because person A is the fastest. 
But if you calculate the total time it takes all four people to get to the end, you 
get 13 minutes. Of course, the pace is dictated by the slowest in the pair. Person 
A would need to go from start to end three times: with B (2 minutes), C (4 min- 
utes), and D (5 minutes). These walks amount to 11 minutes, plus add two times 
that person A needs to walk back alone (1 minute per walk), and you get 13.The 
trick in solving the puzzle is to figure out that you can save most time by letting 
the two slowest people walk together. Here’s the strategy that gets all the people 
across in 12 minutes: 

* Persons A and B walk first from start to end (2 minutes) 
* Person A walks back (1 minute) 

* Persons C and D walk from start to end (5 minutes) 

* Person B walks back (2 minutes) 

* Persons A and B walk from start to end (2 minutes) 


February’s Puzzle: Escaping a Cave 

While hiking a mountain, you enter a cave. Suddenly, rocks fall and block the 
cave's entrance. You turn on your flashlight and start walking deeper into the cave. 
After a while, you find another opening. Unfortunately, however, the opening gives 
way to a sheer rock wall 60 feet above a hikeable surface. You figure that 10 feet 
is the most distance you could jump down without sustaining serious injuries (also 
taking your own height into consideration). 

You look around the cave and find that the ceiling is very high—40 feet above 
the floor. After a while, you find a 40-foot rope hanging from ceiling to floor. A 
few minutes later, you find another 40-foot rope hanging from ceiling to floor. 
You have your hiking knife with you. Can you think of a plan that will let you 
get out of the cave and down the hikeable surface without jumping down more 
than 10 feet? 
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it would have otherwise been rounded up to 
the next day. When converting an integer to 
a datetime, SQL Server simply assumes this 
integer as the offset from the base date, and 
stores 0 as the other integer representing the 
offset from midnight. Although this expres- 
sion is short (and efficient, as I’ll demonstrate 
shortly), I have to say that I feel uneasy with 
it. Рт not sure I can put my finger on exactly 
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why—maybe because it’s too technical, and 
you can't see datetime-related logic in it. 

I like the third technique best of all. I 
learned it from SQL Server MVP Steve Kass. 
It’s very cool! Here goes: 


SELECT DATEADD(day, DATEDIFF(day, 
'19000101', GETDATE()), 
'19000101'); 
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DATETIME Calculations 


The DATEDIFF function calculates the offset 
in terms of days between the base date— 
January 1, 1900—and the input date—GET- 
DATEQ). Call that offset dif: The DATEADD 
function adds diff days to the base date. And 
you have the input date at midnight. The 
anchor date doesn’t have to be the base date 
of January 1, 1900. The important thing to 
remember is that you should use the same 
date in both the DATEDIFF function and 
the DATEADD function. 

Remember that theres no way for you 
to specify a datetime literal; rather, here you 


Г LISTING | Performance Test 


SET NOCOUNT ON; 


DECLARE 
ai AS INT, 
@iterations AS INT, 
astart AS DATETIME, 
adt AS DATETIME, 
doverhead AS INT; 


SET diterations = 1000000; 


-- Overhead 

SET @start = GETDATE(); 
SET ai = 1; 

WHILE gi <= @iterations 
BEGIN 

SET 9i = 8i + 1; 

END 


SET @overhead = DATEDIFF(ms, gstart, GETDATE()); 


specify a character string (1.е., 1190001017) 
that SQL Server will implicitly convert to a 
datetime datatype. Similarly, you can specify 
an integer value representing an anchor date. 
Remember that converting the integer 0 to 
a datetime yields the base date at midnight. 
Bearing this in mind, you can shorten the 
expression to 


SELECT DATEADD(day, DATEDIFF(day, 
Ø, GETDATE()), 0); 


I ran a test to compare the performance 
of the three techniques that I’ve presented. 
Listing 1 shows the code I used, and Table 1 
shows the performance measures. 
I ran the calculation in a loop of 
1,000,000 iterations. 

After subtracting the overhead time 
involved with the code surrounding 
the actual calculation, the first tech- 
nique appears to be the slowest, 
taking. more than twice as long as 
the second and third techniques. 
'The second technique seems to be 
the fastest, but its just a bit faster 
than the third technique, which I 
believe to be the most elegant. 


-- Technique 1 - Convert to character string and 


back 
SET @start = GETDATE(); 
SET ail SZ 
WHILE gi <= giterations 
BEGIN 


SET adt = CASTO 
CONVERTCCHARC8), GETDATE(), 112) 
AS DATETIME); SET @i = 8i + 1; 
END 
SELECT 
'Technique 1' AS technique, 
DATEDIFF(ms, @start, GETDATE()) - 8 
overhead AS ms; 


-- Technique 2 - Convert to integer and back 


SET @start = GETDATE(); 


SET ði = 1; 
WHILE gi <= iterations 
BEGIN 


SET аа = CAST(CAST(GETDATE()- 
0.50000004 AS INT) AS DATETIME); 
SET aa = ai 1; 
END 
SELECT 
'Technique 2' AS technique, 
DATEDIFF(ms, @start, GETDATE()) - 8 
overhead AS ms; 


-- Technique 3 - Based on DATEDIFF 
SET @start = GETDATEO; 


SET Л Т 
WHILE gi <= @1їегаї1оп5 
BEGIN 


SET adt = DATEADD( 


day, 
DATEDIFF(day, Ø, GETDATE()), 
05; 
SET 91 = 8i + 1; 
END 
SELECT 
'Technique 3' AS technique, 
DATEDIFF(ms, @start, GETDATE()) - 8 
overhead AS ms; 
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Extracting Time Only 

The techniques to extract only the 
time are based on logic that’s similar 
to the logic used for extracting only 
the date. You zero the date portion, 
setting it to the base date. ГЇЇ start 
with a calculation that relies on the 
logic from the third technique in 
the previous section: 


SELECT DATEADD( 
ms, 
DATEDIFF( 

ms, 

DATEADD(day, 
DATEDIFF(day, 0, 
GETDATE()), 0), -- 
date only 

GETDATE()), 

05; 


Notice that the DATEDIFF func- 
tion calculates the difference in 
terms of milliseconds between the 
date-only portion of the input date 
and the input date. Call it dif: The 
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TABLE |: Performance Measures 


Technique Milliseconds 
Technique 1 1676 
Technique 2 633 
Technique 3 183 


outer DATEADD function adds diff mil- 
liseconds to the base date (represented by the 
integer 0). 

If you want accuracy in terms of seconds 
instead of milliseconds, simply specify a second 
datepart instead of millisecond (ms): 


SELECT DATEADD( 

second, 

DATEDIFF( 
second, 
DATEADD(day, DATEDIFF(day, 
Ø, GETDATE()), Ø), -- date 
only 
GETDATE()), 

0); 


Of course, you also have the option to use 
logic similar to the logic used in the first 
technique—except that here you'll convert 
the input value to CHAR (14) using style 114 
(hh:mi:ss:mmm) if youre after an accuracy of 
milliseconds: 


SELECT CAST( 
CONVERTCCHAR(12), GETDATE(), 
114) -- 'hh:mi:ss:mmm' 
AS DATETIME); 


If you're after an accuracy of seconds, convert 
to СНАК (8). By doing so, you'll trim the 
milliseconds portion: 


SELECT CAST( 
CONVERTCCHAR(8), GETDATE(), 
114) -- 'hh:mi:ss:mmm' 
AS DATETIME); 


Only the Beginning 
I've discussed the storage format that SQL 
Server uses to store datetime values, focusing 
on challenges related to the fact that there’s 
no separation between date and time. But 
this is only the beginning. There are so 
many more challenges related to datetime 
manipulation. ГЇЇ continue exploring those 
challenges in the coming months. 500 
InstantDoc ID 94487 
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е you ever. had the need to script database schema for archiving purposes? Or 


he SQL-Ma 


с QL agement Options 
(SMO) API in SQL Server 2005 makes it simple to script out tables, stored procedures, 
views, user-defined functions (UDFs), and other schema objects within your databases. 
This article describes a simple Windows console-mode utility called SchemaCollector, 
written in C# using the МЕТ Framework, that you can use to collect database schema. 
You specify a SOL Server instance to run the utility against as a command-line argu- 


ment, and the schema collector program generates individual schema output files for 
(2 tables, stored procedures, views, functions, and roles in appropriate subdirectories within 


W EB a directory hierarchy. You can download the full source code 
15 оп ће for the SchemaCollector utility at http://www.sglmag.com, 
wnload the example code 


and Web figure at InstantDoc ID 94510. 
InstantDoc ID 94510 
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Why Script Your Own 

Schema Collector? 

You might be wondering why you might 
want to write your own schema-collection 
script when you could choose to purchase 
a third-party tool to do the job. With many 
companies nowadays being asked to “do 
more with less,’ some database professionals 
might find that it’s more cost-effective to use 
the powerful functionality that’s built into 
SQL Server. In addition, when a problem 
arises or a change occurs in the environ- 
ment, you can tweak your code and quickly 
get back on track. 


Solution Explorer 


Ea | à (e]| E] & 
ig SchemaCollector 
E- Б] Properties 
G- > References 
^ «LJ Microsoft. SqlServer.ConnectionInfo 
“СЭ Microsoft. SqlServer.Smo 
43 Microsoft. SqlServer.SmoEnum 
: «2 System 
- «3 System.configuration 
«2 System.Data 
i “СЭ System. Xml 
e^ E3 App.config 
с €] Program.cs 
= €] writeLog.cs 


> Ь FIGURE | Project references 


Of course, although generating an indi- 
vidual file for each database object might be 
the most efficient method from a mainte- 
nance perspective, it would be burdensome 
to recreate a large database from these files. 
A typical production database—with, say, 
500 tables—might generate thousands of 
individual files by the time the schema gen- 
erator is through. So you wouldnt use the 
SchemaCollector utility for such a purpose. 
Instead, you would use this program for spe- 
cific, limited purposes. For example, in my 
company, I’ve used the utility for tracking 
schema changes over time and publishing 
production schema for developers. 

Tracking schema changes over time. In 
your company (like mine) you might be 
under pressure to carefully track database 
changes over time to comply with SOX 
and other regulatory initiatives. In a large 
company that has many groups working on 
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various projects, pinpointing the exact date, 
time, and root cause of database problems can 
be difficult-You can use the SchemaCollector 
utility to check the schema output files into 
Visual SourceSafe (or an equivalent source- 
code repository system) to allow analysis of 
schema from a change perspective. Then, you 
can use diff tools and other features built into 
Visual SourceSafe to determine exactly when 
schema changes occurred, where schema 
changes occurred, and why things broke. 
The TABLES, PROCEDURES, VIEWS, 
FUNCTIONS, ROLES directory struc- 
ture that the SchemaCollector utility uses 
lends itself nicely to source-code repository 
maintenance. 

Publishing production schema for devel- 
opers. Some companies have a policy that 
requires that programmers be completely 
locked out of production. In my company, 
the data we manage involves sensitive medical 
and personnel information, so we cant give 
developers the db datareader permission. 
And because its an administrative hassle in 
SQL Server 2000, we don’t even try to give 
them rights to view schema.As a result, devel- 
opment is totally in the dark about what the 
production schema looks like. 


, 


Over time, as programmers “dirty up’ 
their development environment, their 
schema gets out of sync with production. 
So programmers must frequently ask me 
to email the production definitions for a 
handful of tables or stored procedures so 
that they can bring their development envi- 
ronment back into sync with production. 
'To solve this problem, I use the Schema- 
Collector utility to routinely capture our 
production schema across all servers and all 
databases and publish the schema to a central 
directory share. I created an Intranet Web 
viewer application that lets developers view 
the production schema on any production 
server or database at will. I can run the 
SchemaCollector in an ad-hoc fashion from 
the command line to collect schema from all 
databases on one SQL Server instance, or I 
can schedule the utility to run periodically 
(e.g., under the Windows Task Scheduler) 
and collect schema for multiple systems 
weekly or monthly. 


Lel's Get Started 

The C# source-code files for the Schema- 
Collector utility are in the downloadable .zip 
file at InstantDoc ID 94510.The Program.cs 
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Microsoft. SqlServer. NotificationServices 


Microsoft, SqlServer,OlapEnum 
Microsoft. SqlServer.PipelineHost 
Microsoft. SqlServer. RegSvrEnum 


Microsoft, SqlServer. SendMailTask 
Microsoft, SqlServer, ServiceBrokerEnum 


Microsoft, SqlServer.Smo 
Microsoft, SqlServer, SmoEnum 
Microsoft, SqlServer.SqlEnum 
Microsoft, SqlServer, SQLTask 
Microsoft. SqlServer, SOLTaskConnections Wrap 
Microsoft, SqlServer, TableTransFerGeneratorTask 
Microsoft, SqlServer. TransferDatabasesTask 
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Microsoft. SalServer.MotificationServices. Rules 


Microsoft.SqlServer.Replication .NET Programming... 


МЕТ |сом | Projects | Browse | Recent | 


| Component Name — |\езо [Runtime — 4| 


9,0.242.0 ^ v2.0.50727 
9,0,242,0 v2.0,50727 
9,0.242.0 — v2,0.50727 
9,0.242.0 ^ v2.0.50727 
9,0.242.0 v2,0.50727 
9,0,242.0 ^ v2,0.50727 
9.0.242.0 v2,0.50727 . 
9,0.242.0 ^ v2.0.5072 
9,0,242,0 v2.0,50727 
9,0.242.0 ^ v2,0.50727 
9,0.242.0 — v2.0.50727 
9,0.242.0 ^ v2,0.50727 
9,0,242.0 v2,0.50727 
9.0.242.0 


om 
» 


> > FIGURE 2 Adding a project reference to the Microsoft.SgIServer.Smo DLL 
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file contains the main application code, App. 
Config is the application configuration file, 
and WriteLog.cs contains a C# class that’s 
used for logging data to a text file. First, to 
make calls to SMO API functions, we need 
to include the following directive at the top 
of our file: 


using Microsoft.SqlServer. 
Management.Smo; 


Next, we need to add some references 
in our .NET project so that the SMO 
DLLs can be included in the Visual Studio 
project. Before we can write code against an 
external component (e.g., а .NET Frame- 
work component, a COM component, 
an assembly or class library, an XML Web 
Service), our project first needs to contain 
a reference to that component, as Figure 1 
shows. To add a reference in your project, 
from the main Visual Studio menu, select 
Project, Add Reference. Alternatively, you 
can right-click the name of the project in 
the Solution Explorer and select Add Refer- 
ence. You'll see a dialog box that looks like 
the one in Figure 2. 

For the purposes of this project, you need 
three SMO references: Microsoft.SqlServer. 
ConnectionInfo, Microsoft.SqlServer.Smo, 
and Microsoft.SqlServer.SmoEnum. The 
Microsoft.SqlServer.ConnectionInfo DLL 
contains some methods for parsing con- 
nection strings and accessing properties of 
connections. The Microsoft.SglServer.Smo 
DLL contains the real guts of SMO and 
includes instance and utility classes that let 
users manipulate SOL Server programmati- 
cally. The Microsoft.SqlServer.SmoEnum 
DLL contains some classes that make it easy 
to enumerate (or “walk through") all SMO 
objects, as you'd do with a collection. These 
DLL files reside in the Microsoft Visual 
Studio path, typically in the C:\Program 
Files\Microsoft SQL Server\90\SDK\ 
Assemblies folder. 

You'll also want to add a reference to 
the System.configuration class, which lets 
the program read configuration information 
from the App.config file. The App.Config 
configuration file is a good place to store 
entities that can change over time, such as 
database connection strings. In our case, we 
use the configuration file to maintain the 
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base path to the location where schema files 
will be on the file system. 

The program code first reads the name 
of the SQL Server from the command line, 
and attempts to establish a connection to 
that SQL Server instance. We attempt to 
create an instance of the SMO Server class 
by using the following logic: 


// Create an Instance of the 

// Server class. 

Server theServer = new Server(str 
DBMSInstanceName) ; 


If the Server instantiation can’t be estab- 
lished, the code takes an exception path 
and writes an error message to the screen. If 
the Server entity is successfully created (and 
the connection is successful), we attempt to 
retrieve the version of SQL Server. (This 
isnt absolutely necessary, but we do it to 
ensure that we really can communicate with 
the instance through SMO.) 

Once we have a Server instance, we can 
begin to explore the Databases collection. 
The most important line in the code in this 
section 1s: 


foreach (Database db in 
theServer.Databases) 

{ 

} 


This statement lets us iterate through all 
databases in the SMO Databases collec- 
tion to find the SQL Server instance we 
want to document. When you look at the 
source code, you'll see that it deliberately 
avoids scripting information for the SQL 
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Server 2000 pubs and Northwind sample 
databases because we don’t need them for 
this example and will waste disk space. You 
might also want to exclude the SQL Server 
2005 AdventureWorks sample database and 
some of the system databases on produc- 
tion systems. However, for development 
systems, you'll probably want to leave pubs, 
Northwind, and AdventureWorks in your 
schema output. 

For each database it encounters, the code 
scripts out the tables, functions, views, stored 
procedures, and roles in that database. The logic 
to script individual entities is similar in each 
case. The code first creates a scripter object: 
// Define a Scripter object and 
// set the required scripting 
// options. 
Scripter scrp = new 
Scripter(theServer); 


Then, the code sets the appropriate options 
for that scripter object. For example, when 
scripting tables, we can include indexes and 
triggers in the output by setting the proper- 
ties of the scripting options like this: 


// Set Scripting Options. 
scrp.Options.Indexes = true; 
scrp.Options.Triggers = true; 


Once the options are set, the code uses a 
foreach statement to navigate through the 
respective SMO entity collection for the data- 
base and scripts out the schema entities as text. 
The style of programming 1s similar regard- 
less of whether we're scripting tables, views, 
or stored procedures. For example, to move 
through the collection of tables in a particular 
database, you'd use the following code: 


// Iterate through Tables 

// Collection. 

foreach (Table t in db.Tables) 
{ 

} 


For iterating through the views collection, 
the code looks like this: 


// Iterate through Views 

// Collection. 

foreach (View v in db.Views) 
{ 

} 
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And for stored procedures, the code looks 
like this: 


// Iterate through Stored 

// Procedures Collection. 

foreach (StoredProcedure sp in 
db.StoredProcedures) 

{ 

} 


Note that when you're documenting data- 
base schema, its important to include con- 
straints. In the SchemaCollector program 
the line 


scrp.Options.DriALl = true; 


puts in all the DRI constraints. SMO is 
quite flexible, so you have lots of options 
for including and excluding various types of 
constraints. For more information about how 
to include constraints in your schema collec- 
tion script, see the topic “ScriptingOptions 
Members” in SQL Server 2005 Books Online 
(BOL). You'll need to experiment within 
your own environment to come up with the 
combination of scripting attributes that you 
want to include in your version of the script. In 
Web Figure 1 (at InstantDoc ID 94510), you 
can see an example of the output I got with 
the table scripting options Гуе specified in the 
SchemaCollector code for this arücle. 


xeeee STARTING RUN seeeeec 
Attempting Connection: n686235*sq12885 


Meeri SQL Version for: n606235\sq12005 [9.00.1399.906]1 


> DATABASE: AdventureWorks 
TABLE: AWBuildVersion 

TABLE: DatabaseLog 

TABLE: ErrorLog 

TABLE: Department 

TABLE: Employee 

TABLE: EmployeeAddress 

TABLE: EmployeeDepartmentHistory 

TABLE: EmployeePayHistory 

TABLE: JobCandidate 

TABLE: Shift 

TABLE: Address 

TABLE: AddressType 

TABLE: Contact 

TABLE: ContactType 

TABLE: CountryRegion 

TABLE: StateProvince 

TABLE: BillOfMaterials 

TABLE: Culture 

TABLE: Document 

TABLE: Illustration 

TABLE: Location 
Product 
ProductCategory 
ProductCostHistory 
ProductDescription 
Product Document 
Product Inventory 
ProductListPriceHistory 
ProductModel 
ProductModellllustration 


ProductModelProductDescriptionCulture 


ProductPhoto 
ProductProductPhoto 
ProductReview 
ProductSubcategory 
ScrapReason 
Transact ionHistory 


FIGURE 3 
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Also note that some filegroup information 
is included by default when the Schema- 
Collector program is run as written. (You'll 
notice the ON [PRIMARY] attributes 
that are included in the output that Web 
Figure 1 shows.) But full database file- 
group information isnt exposed at this 
level. However, the “Microsoft.SqlServer. 
Management.Smo Namespace” topic in 
SQL Server 2005 BOL explains that the 
FileGroup and FileGroupCollection classes 
are exposed within that namespace. By using 
the Microsoft.SglServer. Management.Smo 
namespace, you could, for example, query 
the Files property ofthe FileGroup member 
to get a list of all the data files belonging to 
a file group. 


Getting Results 

The output of the SchemaCollector pro- 
gram is shown in Figure 3. Each schema 
entity (e.g. table, view, procedure) gets 
scripted to its own individual file. This indi- 
vidual scripting makes it easy to archive all 
schema entities in a source-code repository 
such as Visual SourceSafe. We manufacture 
the appropriate script filename based on 
the entity name, appending the .sql suffix so 
that we know 105 a script file. For example, 
for tables we use: 


// Set the Script 
// File Name. 
scrp.Options. 
FileName - 
strScriptFileDir + 
a"\" + strTableName 
+ "SQL"; 


To do the actual scripting, 
we need to reference a 
Uniform Resource Name 
(URN). This is a special 
address (or handle) that 
uniquely identifies SQL 
Server objects. The SMO 
coding looks like this: 


// Script Out This 
// Table. 


Urn[] urn = new 
UrnE11; 
игпЁ@1 = t.Urn; 


scrp.Script(urn); 
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When the program finishes running, the 
schema output will be in a directory 
hierarchy under the path specified by 
the zBASEPATH identifier in the App. 
Config file. By default, this path is set to 
C:\SCHEMA. 


A Final Warning 

I need to give you a general warning about 
the schema collection process using SMO: 
The scripting process is not always fast. For 
databases with hundreds or thousands of 
tables and stored procedures in them, the 
utility might take several hours to script 
out all the schema entities. For this reason, 
you might want to schedule the schema 
collection program to run unattended. The 
program writes its output to a log file (in 
addition to the screen), and you can use the 
log file to assess progress and watch for any 
errors that may arise. I recommend using 
the screen output to monitor progress 
visually, but the screen output is optional 
and does slow the schema scripting pro- 
cess a bit. So if you don’t want to see the 
screen output, you can simply comment 
out the WriteStatus() function calls in the 
C# code. 

Finally, note that although I haven’t done 
so in the program, you might gain some 
improved program speed if you use the 
Server.SetDefaultInitFields() method when 
you first set the Server entity. Although the 
details are too involved for me to include 
here, by default SMO doesnt retrieve every 
property in its list of entities to be gathered, 
for performance reasons. You can specify 
which properties are included to prevent 
needless round-trips to the server. 

When you use the SchemaCollector pro- 
gram in your own environment, you can run 
the program as needed or schedule it to run 
periodically. In addition, you can easily extend 
the program logic to handle multiple SQL 
instances with a batch file or sumilar mecha- 
nism. Have fun using this utility to create your 
own personalized schema collector. 500 
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John Jakob (john.jakobGKindredhealthcare.com) has 
worked with SQL Server tor approximately nine years, beginning 
with version 6.5. He has been an MCDBA since 2002. 
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—INFRASTRUCTURE LOG 


_DAY 33: Our information is siloed. Unmanageable. 
People can't access the latest info to make decisions. 


Gil's resorted to giving everyone access to everything 
all at once. 


_Monitors now outnumber humans 18 to 1. 


_DAY 36: It's clear to me. We need an IBM Information 
On Demand middleware solution. Info will be liberated 
from the silos—available when we need it, whatever 
the format. Accurate and in context. Now we can make 
smarter decisions and deliver real business value. 


_Access is a beautiful thing. 


Е See innovative ІВМ Info Management solutions in action: 
Information Management IBV.COM/TAKEBACKCONTROL/INFO 


IBM and the IBM logo are registered trademarks of International Business Machines Corporation in the United States and/or other countries. ©2006 IBM Corporation. All rights reserved 
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Nominate yourself or a peer to become an IT Pro of the Month. 
Winners will receive over $600 in IT resources and be featured in 
Windows IT Pro magazine and the TechNet Flash email newsletter. 


While you're at it, take a second and cast your vote for the next 
IT Pro and you could win a one year (12 issues) subscription to 
Windows IT Pro magazine, courtesy of Microsoft. 
Submit your nomination, cast your vote and view our winners at: 
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Subtie Changes You 
Might Have Missed 


Which SQL Server behaviors have 
changed without your realizing il? 


| the year since SQL Server 20055 release, the number of technical sites containing 
По: Server information has burgeoned. Microsofts SOL Server development 
team members host blogs describing little-known details of SOL Server operations and 
best practices. But even with all this information available, some aspects of SQL Server 


have changed subtly—changes that you might have missed. You might not realize that 


e on Ihe WEB 
Download the listings at 
InstantDoc ID 94591 


what you think you know about SQL Server behavior 
is actually no longer true. ГЇЇ give you the straight story 
about three such misconceptions. 


Choosing lo Be a Victim-or Not 

One SQL Server 2005 change that surprised me was an enhancement to the dead- 
lock-resolution algorithm. In SQL Server 2000 and earlier, the SET option SET 
DEADLOCK PRIORITY had two values, LOW and NORMAL. LOW didnt 
mean that you had lower priority for being selected the victim; it only controlled the 
connection in which the value was set. Setting this option to LOW indicated that if 
this connection were involved in a deadlock, it should be chosen the victim. There 
was no way to set your priority to HIGH, to indicate that this connection shouldn't 
be chosen as the victim. 

Га already written and delivered my updated SQL Server Internals course, which 
included a description of SET DEADLOCK. PRIORITY and stated that only two 
possible values could be used. By chance, I came across a reference to setting DEAD- 
LOCK. PRIORITY to HIGH and at first assumed it was a mistake. But when I checked 
SQL Server 2005 Books Online (BOL), I discovered a change I hadn't known about. 

In SQL Server 2005, SET DEADLOCK. PRIORITY lets a process determine its 
priority for being chosen as the victim by using one of 21 different priority levels, from 
-10 to 10.You can still use the value LOW (equivalent to -5) or NORMAL (which is 
0 and the default); you can also specify HIGH (which is 5). 

Which session is chosen as the deadlock victim depends on each sessions deadlock 
priority. If the sessions have different priorities, SQL Server chooses the lowest-priority 
session as the deadlock victim. If both sessions have the same deadlock priority, SQL 
Server selects as the victim the session that’s less expensive to roll back. 


Unnecessary Database Backups 

Another old “fact” that’s no longer true, though still commonly believed, concerns 
database backups.A longtime SQL Server user posted a question on a public newsgroup 
about a behavior change һе noticed in SQL Server 2005. In SQL Server 2000, if 
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he truncated a table, he then had to take 
a full database backup for his log-backup 
chain to be unbroken. He claimed that 
If he tried to take a log backup after the 
TRUNCATE, SQL Server complained. 
I don't know exactly why he generated 
an error, but theres no reason for SQL 
Server 2000 TRUNCATE operations to 
invalidate log backups. This was true in a 
much older version of SQL Server, which 
is probably where he first encountered this 
behavior; he just kept believing it until he 
tried it in SQL Server 2005. 

In SQL Server 2005, 2000, and 7.0, a 
TRUNCATE is a logged operation. Log 
backups containing transactions involving 
a TRUNCATE operation are fully func- 
tional and can be used to restore the 
database as easily as log backups not con- 
taining transactions that perform trunca- 
tions. Because of his outdated belief, the 
user probably spent more time than nec- 
essary performing full database backups. 
I imagine the person who posted this 
question wasn’t the only one using this 
outdated information. 


Maintaining Indexes During 
Bulk Modifications 

Here’s another behavior change you 
might not be aware of. Before SQL 
Server 7.0, it was usually considered a best 
practice to drop all your indexes before 
doing any kind of bulk load operation. 
Bulk loads include the BCP command, 
the T-SQL BULK INSERT command, 
and simple load operators in SQL Server 
200085 DTS or SQL Server 20055 SQL 
Server Integration Services (SSIS, DTS’s 
replacement). Before SQL Server 2000, 
it was usually considered faster to drop 
all indexes, load the new data into an 
unindexed table, then rebuild the indexes. 
Although rebuilding indexes is expensive, 
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this process was less time-consuming—if a 
large percentage of new rows were being 
added—than trying to add those rows while 
maintaining indexes. 

SQL Server 2000 introduced an internal 
technique for processing bulk inserts— 
index-at-a-time modifications—that makes 
inserting data much more efficient, even 
while maintaining multiple indexes. This 
technique is applicable to large update 
operations as well as bulk inserts. 

The alternative to index-at-a-time mod- 


LISTING | Creating a Copy of a Table 
with 4 Indexes 


USE AdventureWorks 
GO 
SELECT * INTO SalesOrderHeader 
FROM Sales.SalesOrderHeader 
GO 
ALTER TABLE SalesOrderHeader 
ADD CONSTRAINT 
LPK SalesOrderHeader SalesOrderIDl 
PRIMARY KEY CLUSTERED 
(CSalesOrderIDJ) 
GO 
CREATE NONCLUSTERED INDEX 
LIX SalesOrderHeader CustomerID] 
ON ESalesOrderHeader1 
(ECustomerIDl1) 
GO 
CREATE NONCLUSTERED INDEX 
LIX SalesOrderHeader SalesPersonIDJ 
ON ESalesOrderHeader1 
(ESalesPersonID1) 
GO 
CREATE NONCLUSTERED INDEX 
LIX SalesOrderHeader2 ContactIDl 
ON ESalesOrderHeader1 
(EContactID1) 
GO 


LISTING 2 Doubling the Number of 
Rows in the Original Table 


INSERT INTO SalesOrderHeader 

SELECT ELRevisionNumber1, 
LOrderDatel,LDueDatel,LShipDatel, 
LStatusl,LOnlineOrderFlagl, 
ESalesOrderNumberl,LPurchaseOrder 

Numberl,LAccountNumber1, 
LCustomerIDl,LContactIDl, 
CSalesPersonID1,[TerritoryID1, 
CBillToAddressID1J, 
LShipToAddressIDl1,LShipMethodID], 
LCreditCardIDl,LCreditCard 
ApprovalCodel, 

ECurrencyRateIDl,LSubTotall, 
CTaxAmt1,CFreight1,[CTotalDuel, 
CComment1,Crowguidd, 
[CModifiedDate] 
FROM CSales].CSalesOrderHeader] 

GO 

SELECT count(*) FROM 
SalesOrderHeader 

GO 


LISTING 3 UPDATE Showing How SQL 
Server Handles Bulk Modifications 


PDATE SalesOrderHeader 

SET CustomerID = CustomerID + 100000, 
ContactID = ContactID + 100000, 
SalesPersonID = SalesPersonID + 1000 


28 February 2007 


ifications is row-at-a-time modifications, 
which was the only possibility before SQL 
Server 2000. For every new or updated row, 
SQL Server maintains each index individu- 
ally, inserting or updating a pointer at the 
appropriate location in each nonclustered 
index. As an example, let use the Sales.Sales 
OrderHeader table from the Adventure- 
Works database. ГЇ make a copy of that 
table and build the clustered index on 
SalesOrderID and nonclustered indexes on 
CustomerID, SalesPersonID, and ContactID. 
If I insert 100,000 new rows, the values of 
CustomerID, SalesPersonID, and ContactID 
will be relatively randomly spread across the 
index leaf levels. For each new row, SQL 
Server would have to find where in the 
CustomerID index to insert or update the 
new CustomerID value, find where in the 
SalesPersonID index to insert or update 
the new SalesPersonID value, and in the 
ContactID index, insert or update the new 
ContactID value. This process could result in 
300,000 random-access data modifications, 
excluding any modifications at the indexes' 
upper levels as more rows are added to leaf. 

Index-at-a-time modifications are pos- 
sible because SQL Server sorts data effi- 
ciently. If sufficient rows are being inserted 
or updated, SQL Server can perform 
repeated sort operations on the data. The 
data can be sorted using the appropriate 
order for each index; then only a single pass 
through that index’s leaf level is needed to 
merge all the new index values into the 
existing index records. 

Run the code in Listings 1 and 2 to create 
a copy of the Sales.SalesOrderHeader table 
and build four indexes on the table. Listing 2 
recopies the original table into the new table 
to double the number of rows to 62,930. 
When I look at the plan for the UPDATE 
query in Listing 3, I see a single clustered- 
index-scan operation (which is the same as 
a table scan) at the far right of the graphical 
plan and a clustered-index update as the final 
step on the left, which represents 91 percent 
of the query’s cost. This operator performs all 
the modifications to all the indexes by using 
the row-at-a-time technique. 

If I run the code in Listing 2 again, ГЇЇ 
increase the table’s size to almost 100,000 
rows. When I now look at the graphical 
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plan for the UPDATE in Listing 3, it looks 
different. I see several icons indicating index- 
update operations and several spool opera- 
tors that indicate SQL Server is collecting 
the index key values in a work table before 
sorting them. Web Figure 1 (http://www 
.sqlmag.com, InstantDoc ID 94591) shows a 
portion of the plan containing the spooling, 
sorting, and index-at-a-time updates. I can’t 
fully explain each operator in your plans here, 
but I want to show plans using each of the 
types of bulk operators (1.е., row-at-a-time 
and index-at-a-time). Depending on the 
resources available on your system, you might 
find that you need to run Listing 2 a different 
number of times to get the index-at-a-time 
plan. My technical editor got the index-at- 
a-time plan the first time he ran Listing 2. 
But when I retested this code on another 
SQL Server machine, I had to run Listing 2 
four times. 

Whether SQL Server chooses to use 
row-at-a-time or index-at-a-time opera- 
tions for insert and update operations 
depends on various factors, including the 
total number of rows modified, percentage 
of existing rows affected by the change, and 
available system resources. I don't mean to 
suggest that you should never drop your 
indexes prior to bulk loads or bulk updates, 
just that you shouldn’t assume it’s always 
better to do so. You need to test your opera- 
tions on your SQL Server systems with your 
data. (For more information and examples 
of testing to determine at what point 
dropping the indexes before modifying 
data might be cheaper, see the case study 


at http://www.microsoft.com/technet/ 
prodtechnol/sgl/2000/maintain/ 
incbulkload.mspx.) 


Little Surprises 
Ive talked about three changes in SQL 
Server behavior that havent been well 
advertised. As you can imagine, these exam- 
ples arent the only areas in which SQL 
Server has changed the way it behaves from 
version to version. The moral: Be prepared 
to be “pleasantly” surprised whenever you 
investigate behavior after any SQL Server 
upgrade, whether to an entirely new version 
or even to a service pack. 500 
InstantDoc ID 94591 
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Add templates, custom 
assemblies, and these 
layout and performance hints 
IO your arsenal 


C hoosing and installing SQL Server Reporting Services (SSRS) is only the first step 
in satisfying the bevy of report consumers in your organization. Now, you need to 
produce dazzling reports that use advanced features for displaying data in the myriad 


by 
Andrew Potter 


ways users want—and still get your other work done. Here are some tips and tricks for 
efficiently creating valuable, flexible reports that perform well, plus a sampling of some 
third-party tools you can use to extend SSRSS functionality. 


Creating a Report Template 

When you create a series of reports, you'll inevitably find report 
items that are common to all the reports, such as the report header, 
an image, a page count in the footer, or even a parameter. Creating 
a template that contains a skeleton of common report items can 
save you time and eliminate some of the repetition that comes 
with report writing. 

To create a report template, add a new report to your report 
server project in SQL Server Business Intelligence Development Studio (BIDS). 
Using the Report Designer, place all the common report items in the report. Then, 
give the report a name such as myReportBasedOnATemplate to indicate it’s a tem- 
plate, as Figure 1 shows, and save the Report Definition Language (RDL) file to 
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C:\Program Files\Microsoft Visual Studio 
8\Common7\IDE\PrivateAssemblies\ 
ProjectItems\R eportProject. Your template 
file will now appear in the Visual Studio 
installed templates list when you add a new 
report to your project, and the new report 
will contain all the common items defined 
in your template. 

If you're a fan of the Report Designers 
Report Wizard, which guides you through 
the report-creation process, you can add 
your own report styles to the Report 
Wizard. Simply edit the StyleTemplates 
xml file located in the directory C:\ 
Program Files\Microsoft Visual Studio 
8\Common7\IDE\PrivateAssemblies\ 
Business Intelligence Wizards\Reports 
\Styles. 


Using Custom Assemblies 

SSRS lets you apply 
simple conditions to 
different report items 
(e.g., values, formatting, 
! styles) by using expres- 
sions and report-level 
custom code blocks. 
However, when writing complex logic or 
sharing functions across multiple reports, it’s 
best to write the functionality as a custom 
code assembly that you reference from 
your report. By placing common custom 
functions, such as special calculations in a 
Microsoft .NET assembly, you gain the full 
power of .NET, better debugging capa- 
bilities compared with the Visual Basic (VB) 
expressions embedded in a report, and the 
ability to maintain your functions in a single 
spot rather than across multiple reports. 
Additionally, report expressions are limited 
to a subset of Visual Basic МЕТ (VB.NET), 
while custom assemblies can leverage either 
C# or VB.NET. 

You reference the custom assembly 
from your report by using the References 
Tab in the Report Properties dialog box. 
Alternatively, you can place the assembly 
reference in a report template file so that 
the functions in your assembly are avail- 
able to all reports that are based on your 
template. After you place the reference in 
the template, you can reference the func- 
tions in your assembly as you would any 
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report-level code block—for example, 
by using a reference such as =Code 
.myAssemblyFunction(). 

When using custom assemblies, make 
sure you understand how to modify 
Code Access Security (CAS) in the SSRS 
policy configurations file so that you 
can execute the assemblies. CAS bases 
security on code, instead of users, so that 
you can appropriately secure expressions, 
code blocks, and assemblies that your 
reports use. (For details about SSRS 
and CAS policies, read the Microsoft 
article "Understanding Code Access Secu- 
rity in Reporting Services" at http:// 
msdn.microsoft.com/library/default 
.asp?url- /library/en-us/rsprog/htm/rsp. 


prog extend install 251a.asp.) You also 


need to mark your custom assembly as 
AllowPartially Trusted Callers Attribute, which 
will remove any implicit LinkDemands on 
your assembly and allow code execution. 


Adding Fields to Page Headers 
and Footers 


You might want your 
reports page header 
to include more than 
just an image and a 
l title. For example, you 
might want to add an 
employee ID or some 
other database field value to the page header. 
However, if you've ever tried to add a field 
from a data set to the page header, you know 
that SSRS rejects the action. But theres a 
workaround: Place the field value in an item 
in the body of the report, then refer to that 
report item in the 
header (for example, 
=Reportltem!txtFie 
IdValue. Value). 

This solution 
has one catch: If 
your header appears 
on each page, the 
report body field 
that you reference 
in the header needs 
to appear on each 
page as well. Also, 
make sure the field 
repeats with each 


Add New ltem | myfiepert roject 
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page break in either HTML or PDF ren- 
dering; otherwise, the field won't appear in 
the header. Note that this tip also works for 
adding fields to a report’s page footer. 


Selting Page Sizes 

- Despite the hype of 
the paperless office, 
users print reports. 
Because most users 
export reports to 
PDF 1f they're going 
to be printed or 
emailed, its a good 1dea to plan the size 
and orientation of the report in advance 
so that it’s printer friendly. 

The items placed on a report often 
dictate size and orientation, but you can 
define page size to optimize viewing reports 
rendered in different formats. To set the 
report size for a report rendered as PDE for 
example, use the PageSize property settings. 
For HTML viewing, specify Interactive- 
Size property settings. Both PageSize and 
InteractiveSize are properties of the Report 
object and appear in the Properties window. 
Setting the interactive page size will expand 
the visible report size within the browser 
but wont affect the report size when it’s 
rendered in other formats, such as PDE 
Remember, even if the HTML version of 
the report doesn’t have any page breaks, the 
PDF version likely will have them. When 
setting the report size, note that SSRS 
defines by default a 1-inch margin on all 
four sides of a report, which is generally 
more than most reports need and eats into 


valuable report space. 


Jeneiates: 


Vanua Studio пум айз templates 
E) Report wizard 
sj Dats Sarca 


Я ee feportTensposoe Landecape 


Му Templates 


| Search Online Тегов 


А Template rdi 
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Create Dashboards and Scorecards 
with SQL Reporting Services 


Use Dundas' industry leading Data Visualization Technology to 
instantly add Dashboard and Scorecard functionality to your reports 
in SQL Server Reporting Services 2005. 


Dundas Chart, Dundas Gauge, Dundas Map and Dundas Calendar for 
Reporting Services offer unique, seamlessly integrated Data 
Visualization functionality that can greatly improve the user 
experience in SQL Server Reporting Services 2005. 


Download full evaluation copies today, and add advanced Business 
Intelligence to your corporate reports. 
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Boosting Productivity and 
Performance 


It’s fairly easy to write 

a query to fetch data 

for a report, display 

the data in one of the 
! various report controls, 

and deploy the report 

to users. But what hap- 
pens when even the best-written query takes 
too long and slow report performance begins 
to irritate users? Theres no panacea for a 
poorly written query, but the following SSRS 
tricks can improve the overall performance of 
your reports. 

Use snapshots to avoid bottlenecks. You 
can avoid the bottlenecks of long-running 
reports by creating a report snapshot to run 
nightly or during periods of low activity 
on your system. A snapshot automatically 
runs the report based on a defined schedule 
and stores the results in the report server 
database. You can then render reports from 
the snapshot instead of from the production 
database, easing the burden on your server. 

If you want to enable report users to 
filter results from the snapshots, you need to 
design the report so that it uses report filters 
rather than a query parameter. A snapshot 
runs for one set of query parameters (if 
present), and if those values change when a 
user executes the report, the snapshot will be 
invalid. I discuss report filters a little later. 

Define pagination to hide overhead. For 
reports returning a large number of records 
for display in a table or list, you can use 
page-breaking pagination to hide much 
of the processing overhead from the user. 
Several report controls feature properties 
for inserting page breaks before or after the 
control or before or after groups within the 
control. For example, if a user requests a 
report that returns 1000 rows of data, you 
can use page breaking to render the initial 
page of results while the report server ren- 
ders the rest of the pages in the background. 
Without pagination, the user would have 
to wait to view the report until SSRS had 
rendered all 1000 rows. 

Implement filters for performance. As 
noted earlier, if you use report-level filtering 
on data regions and data groupings rather 
than using query parameters as filters, SSRS 
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can filter results from an execution snapshot, 
saving you a trip to the production database 
to collect report data.When you use a query 
parameter as a filter, SSRS passes the report 
parameter value to the query that generates 
the data set so that the query can perform 
the filtering. In contrast, when you use a 
filter on a data region, for example, the report 
parameter value is implemented through 
an expression on the data region’s Filters 
tab, as Figure 2 shows. То see how to add 
filters, read the Microsoft article “How-to: 
Add a Filter (Report Designer)” at http:// 
msdn2.microsoft.com/en-us/library/ 
ms156270.aspx. 

Enable drilldowns for detail. Instead. of 
giving users a report that shows all the data 
at once, design a summary report that pres- 
ents a subset of data and let users drill down 
to get more detail. Such a report 
design—using master detail 
reports that take advantage of 
55855 navigation capabilities— 
lets individual users dig deeper 
into data they're interested in 
while avoiding returning huge 
reports to everyone. Many parts 
of a report control have a Navi- 
gation property, which you can 
use, for example, to create a 
hyperlink on the control for 
passing specific values, as Figure 
3 shows, or to navigate to 
another report. 

Use rectangles for consis- 
tency and efficiency. Consider 
grouping report items in rect- 
angles for more controlled and 
consistent formatting and easy 
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stored procedure, view, or query on which 
a report is based changes, you must update 
the report data set to reflect the changes. 
You can re-execute the data set to update 
it by clicking the exclamation mark on 
the Dataset toolbar. Then, click the data set 
Refresh button on the Dataset toolbar. The 
refresh operation will use any parameters 
entered during the execution and will add 
or remove any fields or parameters changed 
in the underlying procedure, view, or query. 
This process automatically discovers any 
changes, eliminating the need to change 
parameters on both the Report menu and 
the Dataset dialog box. 

Take advantage of free reports. Microsoft 
provides many free SSRS code samples, 
including valuable Report Packs that give 
you predefined reports for reporting against 


Ё Table Properties 
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Expression 
+ "ёё egent D. Value 


. 3 Я Bookmark ID: 
object movement. With this == Я C£) 
strategy, you can hide several T 
: d : 1 Hyperlink action 
items at once and in one place, Gan 
you can place multiple text 

E r CJ Jump to report 

boxes contained in a rectangle 2 
into а single table cell, and you nS " 
have more pagination options. he 
Place report items inside a rect- © 
angle by dragging and dropping «i LEJ 
or cutting and pasting them. 
To verify that an item is inside [c ][ ш) 


the rectangle, check the report 
item’s Parent property. 
Refresh data sets. When a 
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> > FIGURE З Using the Navigation property to 
create a hyperlink for passing values 
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Microsoft IIS, SQL Server Integration 
Services (SSIS), Exchange Server, Windows 
SharePoint Services, Great Plains, and other 
Microsoft applications. Report Packs are 
not only useful out of the box, but also 
serve as examples for how to build your 
own custom reports. For information about 
Report Packs, see the SQL Server 2005 
Report Packs download page at http:// 


www.microsoft.com/downloads/details 


.aspx?familyid-d81722ce-408c-4fb6-3429- 


2a7ecd62f674&displaylang=en. 

You can find another set of free reports in 
the SSRS samples, including easy-to-install 
execution log reports that show report-log 


Reporting Services Tips and Tricks 


activity in your environment. The execution 
log reports require you to create a small 
database and SSIS package (provided in 
the sample) to hold execution data. The 11 
SSRS samples include reports such as the 
must-have Average Report Execution Time, 
Longes Running Report, and Reports 
By Month. You can find more informa- 
tion about SSRS samples in the Microsoft 
article "Monitoring Report Execution Per- 
formance with Execution Logs" at http:// 
msdn.microsoft.com/library/default 


.asp?url—-/library/en-us/dnsqI90/html/ 


rsmnrptexpf.asp. 

Embed basic JavaScript code in a report. 
You wont find this tip in any 
Microsoft documentation, but 
a few lines of JavaScript code 
can enhance report interac- 
tivity. Using the expression 
—"javascript:history.back()" in 
a text box provides a handy 
Back button, for example, and 
="Javascript:void(window. 
open(url'))" lets you open a 
link without leaving a report. 

Implement dynamic images 
for a scorecard feel. Report con- 
sumers love colorful reports, 
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and including images is a 


> » FIGURE 4 Giving the GeoGroup parameter unique 


values 


Grouping and Sorting Properties 
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great way to add pizzazz and 
highlight important values on 
a report. Conditionally pre- 
senting images, such as a stop- 
light for a value out of range or 
a check mark for a value that 
meets or exceeds expectations, is 
a valuable way to communicate 
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Expression 


Felis Par annters!GeoGroup. Value). Value 


Label: 
afela Parameters! Georoup Label). Vale 


Parent group: 


to group on 
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> > FIGURE 5 setting the expression you want 


information to users and give 
your report a "scorecard" feel. 
You can conditionally show or 


hide an image by using expres- 
sions for the image’ Visibility: 
МА Hidden property. 
I Display selected parameter 


values in the report header. If 
you've ever looked at a report 
after you've exported it to PDF 
(or any other rendering format), 
you understand the importance 
of displaying certain parameter 
values in the report header. 
Without being able to see the 
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built-in or custom parameter selections, a 
report consumer has no idea what the param- 
eters were when the report was run. You can 
prevent user headaches by placing expressions 
(such as =Parameters!ParamName.Value or 
=Join(Parameters!MultiParamName. Value, ", 
") in a few text boxes in the page header to 
show which multiselect report parameter 
values were selected when the report was 
executed. 

Use dynamic grouping for control. 
Although you can’t control everything on 
a report by using expressions, you can con- 
trol grouping this way. In some cases, you 
can even avoid writing an additional re- 
port by using expression-based grouping. For 
example, you could use expressions to 
design a report that features a grouping on 
Region and let users drill down on 
the value for a specific region. You can use 
the same design technique to then let 
users drill down on values for specific sites 
in that region. Just set up a parameter called 
GeoGroup and give it unique values such 
as RegionID and SiteID, as Figure 4 shows. 
In the data region, set your grouping to the 
expresion =Fields(Parameters!GeoGroup. 
Value).Value, as Figure 5 shows. Now the 
data region’s grouping is parameter-based, 
making the report reusable and more 
flexible. 

Go further with ReportViewer controls. 
Many SSRS implementations don’t go 
beyond deploying a report to the Web 
and giving users a URL for access. But for 
developers who want to create customized 
parameter selection or integrate reports into 
an existing application, the Visual Studio 
2005 ReportViewer controls are the place 
to start. There are two freely redistributable 
ReportViewer controls: one for Web appli- 
cations and one for Windows applications. 
You can configure both controls to run in 
remote mode (which retrieves and displays 
reports from the report server) or local 
mode (which processes a report based on 
an .rdlc file deployed directly on the client). 
An advanced feature of the ReportViewer 
controls is the ability to consume a DataT- 
able or public properties on enumerable 
objects such as the report’s DataSource. For 
details about ReportViewer controls, see 


http://www.gotreportviewer.com. 
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| Tools 
still a rela- 
tively new product, but 
it leverages the open 
RDL standard for 
j defining reports. As the 
product matures, more 
third-party vendors 
will offer tools that support and extend its 
functionality. Here is a sampling of tools that 
already can enhance your SSRS reports and 
offer additional functionality. 

OfficeWriter. If youve worked much 
with SSRS, you've probably had report 
consumers ask if they can export a report 
to Microsoft Word or add a formula when 
they export a report to Microsoft Excel. You 
currently can’t perform these functions with 
SSRS, but you can with Software Artisan’s 
Office Writer. Office Writer creates templates 
that let you export SSRS reports to either 
Word or Excel,while preserving the func- 
tionality of a true Word or Excel document. 


Office Writer also lets end users write reports 
from within Word or Excel (without using 
Visual Studio) and publish the resulting RDL 
file to the report server. You can learn more 
about OfficeWriter at http://officewriter 
-softartisans.com/officewriter-250.aspx. 
Dundas controls. Dundas software now 
supples advanced controls for SSRS. The 
Dundas Chart for Reporting Services 
includes advanced chart visualizations and 
additional chart types and statistical formulas. 
If you're going to do more than basic charting 
or want your charts to stand out, Dundas 
Chart for Reporting Services is the way to 
go. Dundas also offers three other compo- 
nents for SSRS: Dundas Gauge, which adds 
dashboard and scorecarding features to reports; 
Dundas Calendar, which adds date-related 
visualization elements; and Dundas Map, 
which adds map visualization features. For 
more information about Dundas Chart for 
Reporting Services, see http://www.dundas 
.com/products/chart/rs/index.aspx. 


IDAutomation has 
leveraged its .NET Forms Control to 
render barcodes inside an SSRS report. For 
more information about the company’s 
.NET Barcode Forms Control, see http:// 
idautomation.com/reporting. services. 


Barcode control. 
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Because reporting is a key task in every orga- 
nization, SSRS is a very useful tool. SSRSS is 
designed to help you quickly and efficiently 
develop and deploy reports, but the more 
product experience and knowledge you have, 
the more value you can deliver to your users. 
You'll soon begin collecting your own SSRS 
tips and tricks and developing workarounds to 
fit your needs. 500 
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Е or a while now, I've suspected that the execution plan the SOL 
Server 2005 query optimizer typically chooses for a common 
query pattern 1s suboptimal, but until recently I never bothered to try 

and prove it. Not long ago, though, I managed to confirm that my sus- 
by picions were correct. I'll describe my findings and recommend a course 
of action to optimize the default suboptimal plan. And in the sidebar 
“More Fun With Execution Plans,” page 


" 
<5 
yid 


| f | [ on Ме WCE 
37, I discuss another interesting example Download the listings at 


of optimizer behavior. InstantDoc ID 94775 


Suboptimal Plan for an ORDER BY Query 

The query pattern I refer to occurs when you request to sort rows from a table based on 
a column on which you have a nonclustered, noncovering index. For example, suppose 
you have a table T1 with columns coll (INT), col2 (INT), and filler (CHAR (200)). 
The table has a large number of rows (say 1,000,000). You have a clustered index on 
J)O m es, coll and a nonclustered index on col2. Examine the following query, and try to think 


pc ible to of an optimal execution plan for it: 


Е P is an : in e There are more than two possible execution plans for this query, but these two are the 
i е [s JIImz eft: most straightforward: 

| | . Perform a full table scan (unordered clustered index scan), then sort the rows 
H ere OW со]? (call this plan Table Scan Plus Sort). 
ordered nonclustered index scan of the leaf of the index on col2, 
each data row by performing a seek operation in the clustered 
sh row (call this plan Ordered Index Scan Plus Lookups). 


SELECT * FROM dbo.T1 ORDER BY col2; 


For large tables (with hundreds of thousands or millions of rows), the optimizer opts 
for Table Scan Plus Sort by default, whereas I propose that Ordered Index Scan Plus 
Lookups is more optimal. Maybe the costing algorithms that the SQL Server 2005 
optimizer uses for this query type rely here on relics from older systems. 
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In terms of logical reads alone, of course, 
Table Scan Plus Sort involves many fewer 
logical reads than Ordered Index Scan Plus 
Lookups. For this example, lets assume that 
table T1 resides on 25,000 pages (in the clus- 
tered index’ leaf) and that the number of pages 
in the nonclustered index on col2 is 2000. 
Both the clustered and nonclustered indexes 
have three levels in the balanced trees. 


LISTING | Creating and Populating Table T1 
in testdb 


SET NOCOUNT ON; 

IF DB ID('testdb') IS NULL 
CREATE DATABASE testdb; 

GO 

USE testdb; 

GO 


-- Create the function fn split 

IF OBJECT ID('dbo.fn nums', 'IF') IS NOT 
DROP FUNCTION dbo.fn nums; 

GO 


CREATE FUNCTION dbo.fn nums(àn AS INT) 
RETURNS TABLE AS RETURN 


WITH 
CØ ASCSELECT Ø AS const UNION ALL SELECT 
C1 ASCSELECT Ø AS const FROM CØ AS A, CO 
C2 ASCSELECT Ø AS const FROM C1 AS A, C1 
C$ ASCSELECT D AS const FROM C2 AS A, C2 
C4 ASCSELECT Ü AS const FROM СЗ AS A, СЗ 
C5 ASCSELECT 0 AS const FROM C4 AS A, С^ 
C6 ASCSELECT @ AS const FROM C5 AS A, C5 
SELECT ТОРСӘп) ROW_NUMBER() OVER 

(ORDER BY const) AS n 
FROM C6; 
GO 
-- Create the table T1 
IF OBJECT ID('dbo.T1', 'U') IS NOT NULL 


DROP TABLE dbo.T1; 
GO 

CREATE TABLE dbo.T1 

( 

col1 INT NOT NULL, 

col2 INT NOT NULL, 

filler CHARC200) NOT NULL 
Dr 


CREATE CLUSTERED INDEX 
Тах cl сот ON або 2тиїСсои 29 
CREATE NONCLUSTERED INDEX 
idx nc, col2 ON dbo.T1(col2); 
GO 


-- Populate Т1 with 1,000,000 rows 
DECLARE @numrows AS INT; 
SET 8numrows - 1000000; 


TRUNCATE TABLE dbo.T1; 


INSERT INTO dbo.T1(col1, col2, filler) 
SELECT n, 1 + ABS(CHECKSUM(n)) 
% 1000000000, 'a' 
FROM dbo.fn nums(gnumrows); 
GO 


NU 


With Table Scan Plus Sort, the number 
of logical reads is 25,000. With Ordered 
Index Scan Plus Lookups, 2000 logical 
reads are required to fully scan the leaf level 
of the nonclustered index, plus 1,000,000 
X 3 logical reads for the lookups. In total, 
you get more than 3,000,000 logical reads 
for Ordered Index Scan Plus Lookups. So 
in terms of logical reads alone, obviously 
Ordered Index Scan Plus Lookups involves 
many more than Table Scan Plus 
Sort. 

However, sorting a large number 
of rows can be very expensive. Table 
Scan Plus Sort needs to sort as many 
rows as the number of rows in the 
table, whereas Ordered Index Scan 
Plus Lookups involves no sorting at 


Ek all because the nonclustered index 
on coD is scanned in order. The 
cost of each lookup is constant 
(three reads), whereas the cost of 
sorting isn’t linear—that is, in terms 
of algorithmic complexity, sorting 1s 

D, n log(n). Even worse, if the table is 

d too big, so that theres not enough 
в), memory for the sort operation, 
к SQL Server will have to spill rows 
B 


to disk to manage the sort opera- 
tion; in this case, sorting becomes 
substantially more expensive. 
Before I present a benchmark 
proving this point, run the code 
in Listing 1 to create the table T1 


in the testdb database and populate it with 
1,000,000 rows. The code first creates a 
helper function called fn. nums that returns 
a result set with a sequence of a requested 
number of integers. The code then uses this 
function to populate T1 with the requested 
number of rows (1,000,000). 

Now request the estimated execution 
plan for the following query: 


SELECT * FROM dbo.T1 
ORDER BY col2; 


You'll get the execution plan that Figure 1 
shows: Table Scan Plus Sort. 

To measure this plan’s performance, in 
SQL Server Management Studio (SSMS), 
go to Tools, Options, SQL Server, Query 
results, Results to grid, and select the Discard 
results after execution check box; doing so 
eliminates the time it takes to generate the 
output. Then in a new query window, run 
the following code: 


USE testdb; 

DBCC DROPCLEANBUFFERS; 

SELECT * FROM dbo.T1 
ORDER BY col2; 


On my test system, this query took more 
than two minutes to run (the runtime in 
seconds is displayed at the bottom-right 
corner of SSMS). 


Forcing an Optimal Plan 
To test the performance of the desired 


Query 1: Query cost 
SELECT * FROM dbo.T1i ORDER 


SELECT 
Cost: 0% 


(relative to the batch): 


100% 


lity 


Clustered Index Scan 
[testdb]. [dbo] . [T1] .[idx_cl_coll] 
Cost: 6% 


BY col2; 


> р FIGURE | Default execution plan 


Query i: Query cost (relative co the batch): 100% 
SELECT * FROM dbo. Ti WITH (index = idx m ORDER BY со12; 
4. 
E B te] - 
EXIST orc Nested Loops Index Sean 
> : (Inner Join) [testdb] . [dbo]. [T1 1. [idx ne colzl 
Cost: Ô 4 Cose: 42% Coat 
Com: 1% Cost: OF 
sty 
Clustered Index Seek 
[test db] . [doo]. [T1]. [$dx ei coll) 
Cost: 25 4 


> Ь FIGURE 2 Execution plan for query containing an index hint 
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If you can't get enough of the types of 
T-SQL challenges I pose in my articles, 
you'll find more T-SQL exercises to 
sharpen your expertise in my Puzzled 
by ESQL blog, at http://www.sqlmag 
.com/blog/index.cfm?action=blogind 
ex&DepartmentID=1016. Here’s a 


recent post that delves into an execu- 
tion plan for an aggregate query. 

In the last meeting of the Israeli 
SQL Server Users Group, SQL Server 
MVP Ami Levin demonstrated an 
interesting technique that the opti- 
mizer uses to optimize aggregates. 
(Ami used SQL Server 2005 Devel- 
oper Edition, Service Pack 1—SP1.) 
Consider the following query: 


USE Northwind; 
SELECT E.FirstName, 
E.LastName, 

COUNT(*) AS NumOrders 
FROM dbo.Employees AS E 
JOIN dbo.Orders AS 0 

ON E.EmployeeID = 
0.EmployeeID 
GROUP BY E.FirstName, 

E.LastName; 


There are nine employees in the 
Northwind database who handled 
830 orders. Northwind is a small 
sample database, but the ratio between 
employees and orders you find in 
Northwind is common in production 
environments in the sense that each 
employee handles a large number of 
orders. 

You'd probably expect that the 
execution plan would first perform a 
join between Employees and Orders, 
then group the result of the join by 
the employee’s first and last names, 
and then calculate the aggregate. 
Thinking in more realistic table sizes in 
production environments, this would 
mean a join between a small table of 
employees and a large table of orders. 


www.salmag.com 
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More Fun with Execution Plans 


But apparently the optimizer has a 
sophisticated trick under its sleeve. 

Examine the execution plan for 
this query. Figure A, page 38, shows 
the textual actual execution plan 
produced by the SET STATISTICS 
PROFILE session option; I've abbre- 
viated the output for clarity. (You'll 
probably find it more convenient to 
examine the graphical execution plan 
yourself, though.) I added a column 
called Seq to reflect the processing 
order of the operators. 

The plan first performs an index 
order scan of the index Orders. 
EmployeesOrders (Seq = 1). This is 
the narrowest index on the Orders 
table that contains the EmployeeID 
column. In fact, the EmployeeID column 
is the only column in the index. 

The second operator in the plan 
(Seq = 2, Stream Aggregate) calculates 
the count of rows for each Employ- 
eeID and stores that count for each 
group as a computed value called 
[partialagg1005]. The interesting part 
here is that the query asked to aggre- 
gate by the employee’s first and last 
names, but the optimizer figured that 
since the EmployeeID column is the 
primary key in the Employees table, a 
given EmployeeID value corresponds 
to one and only one combination 
of FirstName, LastName values (not 
necessarily the other way around). 
The optimizer decided to calculate the 
count of rows for each EmployeeID 
prior to the join; hence the outer input 
of the join becomes much smaller 
(nine rows instead of 830 rows). 

The Nested Loops join that shows 
up in the plan (Seq = 3) operates on 
much smaller inputs (nine and nine 
rows instead of 830 and nine rows). 
For each of the nine rows returned 
from the Stream Aggregate operator, 
the Nested Loops operator performs a 
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Clustered Index Seek operation (Seq 
= 4) in the clustered index on the 
Employees.EmployeeID column ќо 
retrieve the corresponding employee 
row from the Employees table. The 
row from the Employees table con- 
tains the FirstName and LastName 
columns. 

The rows produced by the join (nine 
rowsin total) are then sorted by LastName 
and FirstName (Seq = 5), then aggre- 
gated (Seq = 6). The last aggregate 
that you see in the plan (Stream 
Aggregate, Seq = 6) is needed because 
technically there might be more than 
one employee with the same first and 
last names. However, the nice thing 
about this aggregate is that it operates 
on a small set of rows with the partial 
aggregates that were precalculated for 
each EmployeeID value. 

Of course, there's little business 
logic in aggregating data from multiple 
employees just because they happen to 
have the same first and last name. If 
you revise the query slightly and add 
E.EmployeeID to both the GROUP 
BY and SELECT clauses, you'll see 
that the second aggregate is eliminated 
altogether. You'll see only the aggre- 
gate taking place against the input 
rows from the Orders table prior to 
the join, knowing that the relationship 
between EmployeeID and (FirstName, 
LastName) is 1:1. 

I find this to be a cool technique. 
It eliminates the need for us to com- 
plicate our code, writing an aggregate 
query ourselves against one of the 
tables, storing the result in a tempo- 
rary table, then joining to the other 
table. There are many such tricks that 
the optimizer hides under its sleeve, 
letting us focus on the logical aspects 
of the code, and the optimizer on the 
performance aspects. 

InstantDoc ID ) 94828 
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plan (Ordered Index Scan Plus Lookups), 
I wanted to force SQL Server to use the 
nonclustered index. Initially I thought that 
doing so would be simple—just specify an 
index hint. But the task proved to be more 
complicated than I expected. 

Here’s the index hint that I added to the 


query: 

SELECT * FROM dbo.T1 WITH 
(index = idx nc, col2) 
ORDER BY col2; 


To my surprise, instead of getting Ordered 
Index Scan Plus Lookups, I got the execu- 
tion plan that Figure 2, page 36, shows. I 
didn't expect this plan, but after I analyzed 
it, I understood what was going on. First, 
the leaf level of the nonclustered index is 
fully scanned but without reliance on order 
(Ordered = False). The rows returned from 
this scan are then sorted based on the clus- 
tering keys (1.е., first sort operator in the plan). 
'The reason for this sort is to optimize the 
lookups for the data rows (Clustered Index 
Seek operator). If you think about it, SOL 
Server fetches data rows that reside in the 
same data page by using the Clustered Index 
Seek operator consecutively. After all data 
rows are fetched, the rows are sorted based 
on their со]? values (i.e., second sort operator 
in the plan). 

Interesting as it might be, this plan is still 
less efficient than the one I want: Ordered 
Index Scan Plus Lookups. The problem I 
faced at that point was that by using a simple 
index hint, I could force the optimizer to 
use the nonclustered index, but not in the 


Query 1: 


Query cost [relative to the batch): 
SELECT * FROM dbo.Tl WITH 


100% 
(index = idx пс colz) ORDER BY col12; 


Berted Loops 


manner in which I 
wanted it to be used 


fe] us 


Index Scan 
(testdb2] . [dbo! . [T1]. (ádx nc col2] 
Cost: 50% 


(inner Join) 
Cos: 0% 


(namely, ordered sty 

Clustered Index Seek 
сап followed by [test d52] . [dbo] . [T1]. (ídx с1 соц 
lookups). Cost: 50 4 


Originally I 
thought that my 
only option to force the optimizer to use 
the desired plan was to use a new query 
hint in SQL Server 2005 called USE PLAN. 
This hint lets you provide an XML value 
containing a complete execution plan that 
you want SOL Server to run. But apparently 
theres a much simpler option—to use the 
FASTFIRSTROW query hint. This hint 
tells the optimizer that you want a plan that 
will return the first row as quickly as possible. 
The default plan that the optimizer chooses 
when no hints are specified has to first finish 
sorting the data before it can return the first 
row. Therefore, it can take some time before 
SQL Server can return the first row. By using 
an ordered scan of the nonclustered index, 
SQL Server can return the first row almost 
instantly. So although the optimizer estimates 
that in terms of throughput (total runtime) 
Ordered Index Scan Plus Lookups is less 
efficient than Table Scan Plus Sort, doubtless 
the former is faster in terms of response time 
(first row returned). Thus, by specifying the 
hint, as in the following query, you get the 
desired plan, which Figure 3 shows. 


SELECT * FROM dbo.T1 WITH 
CFASTFIRSTROW) ORDER BY col2; 


This query ran for about 20 seconds on my 
test system—several times faster than with 


> » FIGURE З Desired execution plan 


the default plan (Table Scan Plus Sort). 


Trust Your Intuition 

I ran a benchmark testing the two plans 
using table sizes ranging from 100,000 rows 
to 1,000,000 rows in steps of 100,000 rows. 
Web Figure 4 (http://www.sqlmag.com, 
InstantDoc 94775), shows the benchmark 
results. You can see that in all cases, Ordered 
Index Scan Plus Lookups (forced with the 
FASTFIRSTROW hint) is substantially 
faster than Table Scan Plus Sort. 

This exercise was an important lesson 
for me. Trust your intuition, and when you 
suspect that a plan that the optimizer 
produces isn’t optimal, benchmark to check 
whether your suspicions are correct. I’m not 
saying that it’s common to get suboptimal 
plans in trivial cases, but it’s good to know 
that when you do find such a plan you have 
tools to deal with it. In such cases, it’s 
important to report the problem to 
Microsoft, as I did. [SQL| 

InstantDoc ID 94775 


Itzik Ben-Gan (itzik@solidqualitylearning.com), a 
mentor at Solid Quality Learning, teaches, lectures, and consults 
internationally. He manages the Israeli SQL Server Users Group, is a 
SQL Server MVP, and is the author of the /nside Microsoft SQL Server 
2005: T-SQL series (Microsoft Press, 2006). 


(> FIGURE A Execution plan for sample query 


|--Compute Scalar (DEFINE: (СЕхрг10041= 


CONVERT_IMPLICIT(int,Lglobalagg10061,0))) 


|--Stream Aggregate( 


GROUP BY:(LEl.LLastNamel, LEJ.LFirstName1) 
DEFINE:(CEglobalagg10061-SUM(Epartialagg10051))) 


Rows Seq StmtText 

9 8 SELECT же 
0 Й 

9 6 

9, 5 

9, ТА 

9 2 

830 1 

9 4 
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|==Sort¢ 
ORDER BY:(LEJ.LLastNamel ASC, 
CE].CFirstName] ASC)) 
|--Nested Loops( 
Inner Join, 
OUTER REFERENCES: (C01].CEmployeel 
|--Stream Aggregate( 


D1)) 


GROUP BY:(LOJ.LEmployeeIDJ]) 
DEFINE:(Lpartialagg10051-2Count(*))) 


|--Index Scan¢ 


OBJECT:(LOrdersl.LEmployeesOrders] AS [0]), 
ORDERED FORWARD) 

|--Clustered Index Seek( 

OBJECT:(LEmployeesl.LPK Employees] AS [E]), 

SEEK: (CEJ.CEmployeeIDJ=COrders1].LEmployeeID1)) 
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Product Review 


DatahaseSpy 2007 


Simplify data management in a 
heterogeneous database environment 


IT professionals and consultants often must 
work in heterogeneous database envi- 
ronments. The available database client tools 
range from command-line tools to GUIs. 
Understanding the nuances of all these 
client applications can be expensive and time 
consuming. Altova, maker of the popular 
XMLSpy XML editing tool, has released a 
new product called DatabaseSpy to address 
these problems. DatabaseSpy is a multi- 
database management and design tool that 
provides a common interface for professionals 
who routinely work with different database 


jp 


| 


environments. 

I installed DatabaseSpy on a Windows XP 
machine. (Its supported on Windows 2000, 
XP and Windows NT). The installation was 
straightforward, with only one configuration 
option—the option to make DatabaseSpy 
my default SQL editor, which would increase 
efficiency if I want to use DatabaseSpy as my 
prumary database client tool. After installa- 
tion, I opened the shortcut on my desktop 
and was presented with the Quick Connect 
dialog box that displayed a number of built-in 
database connection options. I chose Micro- 


pas dv Dom ew 
> > FIGURE | DatabaseSpy’s Design Editor 
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ALTOVA DATABASESPY 2007 


PROS: Connects to several different relational 
database management systems 


CONS: Can access only table objects 
RATING: УС YX YX YX 


PRICE: $129 for a single-user license. Support 
cost is 25 percent of license fee for one year; 20 
percent of license fee for two years. 


RECOMMENDATION: DatabaseSpy is a good 
solution for IT professionals who must maintain 
a number of database schemas on different 
database management systems. It doesn't 
provide enough functionality for the DBA. 


CONTACT: Altova e 978-816-1600 e http:// 
www.altova.com 


soft SQL Server and proceeded through the 
connection wizard. After I selected my local 
database server and a database, the Project View 
window opened, displaying the connection I 
had just configured. I then clicked the Online 
Browser tab to view the database schemas and 
the objects within each schema. 

Running queries from any table was easy 
using DatabaseSpy. The data is returned in a 
common Results window. I also was able to 
export table data into a number of different 
formats, including XML, comma-separated 
value (CSV), Microsoft Excel, and HTML. 
Unfortunately, DatabaseSpy offers only 
one format option for importing—CSV. 
I would have liked to see more options, 
such as importing from other databases or 
importing other formatted data, such as tab- 
delimited files. 

DatabaseSpy also lets you open a 
table directly in the SQL Editor window. 
From there, you can choose to generate 
SELECT, CREATE, INSERT, UPDATE, 
or DELETE statements. All SQL statements 
are auto-generated and appear in the SQL 
Editor window. 
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While working in the SQL Editor, I tested 
the auto-complete feature and was impressed. 
As I typed the SELECT statement into the 
SOL Editor, the auto-complete list appeared 
showing potential tables, functions, or proce- 
dures that I could query. The only drawback 
I found is that the auto-complete list can take 
some time to load, especially if the database 
contains a lot of objects such as tables and 
procedures. 

I think the Design Editor, which Figure 1, 
page XX, shows, is the feature that provides 
the most benefit to IT professionals. I was able 
to add existing tables to the design view, create 
new tables, and add and edit columns with one 
click of a button. I could view relationships 
and save the design for additional modification. 
Each time I made a change to a table or added 
anew table, the SOL Editor window appeared 
at the bottom, generating SQL statements to 
execute when I was ready to commit these 


changes to the database. 


I did run into a few problems while 
working in the Design Editor. I added a table 
and tried to change the table name. The table 
name wouldn't always change in the design 
view. I found the same behavior was true 
when trying to change column names in the 
Design Editor. A rename option doesnt exist 
in the Design Editor’ file menu. As a work- 
around, I opened the SQL Editor window, 
changed the table and column names, and 
executed the script. 

One feature I missed was the ability to 
create a column of data type XML when con- 
nected to a SOL Server 2005 database. One of 
the highlighted features of DatabaseSpy is its 
increased interoperability with XML. Adding 
native support for the XML data type seems 
like a logical addition. 

Altova also could make this tool more 
robust by adding UI support for stored pro- 
cedures and user-defined functions (UDFs) or 
user-defined data types (UDTs). Several other 
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database client tools support not only tables 
and views, but also stored procedures, UDTs, 
and UDFs. 

One crucial feature that’s missing for DBAs 
is the ability to back up and restore an entire 
database, along with scheduling of these opera- 
tions. If DatabaseSpy seeks to be a replace- 
ment for existing client tools, it must have this 
capability. 

DatabaseSpy is a good option for IT 
professionals who need to perform database 
updates or schema changes, and the conunon 
interface makes it easy to access the different 
data sources. However, without better UI sup- 
port for stored procedures, UDTs, and UDFs, 
assignment of data types, and database backup 
and restore scheduling, this product isn’t robust 
enough for the DBA. 500 

InstantDoc ID 94548 


Michael D. Cassens (michael.cassens@aeshen. 
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SQL Server 5.7 


Quest Software's real-time performance 


monitoring tool 


tool designed to help you easily detect and diagnose SQL Server database performance 


Q uest Software’s Spotlight on SQL Server 5.7 is a database performance monitoring 


problems by means of a graphical UI. Spotlight on SQL Server lets you view real-time 
server activity so that you can locate problematic database activity. 


Installation is a breeze, and it’s easy to 
configure monitoring connections to your 
existing servers. In fact, once you connect, a 
wizard prompts you to configure a calibration 
interval (spanning from minutes to hours) 
within which the tool will monitor overall 
activity to compute a baseline. Although I 
didn't determine how the baseline was com- 
puted, I did notice that Spotlight on SQL 
Server did a great job of informing me when 
my servers departed from normal operating 
parameters, such as when I launched a large 
RESTORE operation or when I began 
thumping one of my databases with several 
complex and automated INSERTs. 

Spotlight on SQL Server’ alerting is very 
intuitive. Monitored subsystems and compo- 
nents default to a green display (indicating 
subsystems and components are running as 
they should) in top-level monitoring screens 
and transition to yellow (indicating warning) 
and red (indicating crisis) depending on how 
severely they deviate from established baselines 
or as they come under increased load.The UI 
also flashes the names of servers encountering 
problems in the Live connections pane so that 
you dont miss anything if youre monitoring 
multiple instances. 


Spotlight on SQL Servers intuitive UI 
makes it easy for you to drill down into the 
details of each subcomponent’s performance 
and to see complex details about current 
activity from various angles. Spotlight on 
SQL Server provides complex graphs, charts, 
and data grids that contain precise details 
about individual database files, overall disk 
utilization, breakdowns of resource utilization 
by user or session, and cache and buffer hit 
ratios by object. Without Spotlight on SQL 
Server, you would have to glean data from 
Perfmon, SQL Profiler, and a handful of 
ninja-caliber admin scripts. Spotlight on SQL 
Server, however, presents this data in graphical 
form, making it easy to distill mounds of data 
with the click of a mouse.The time that this 
functionality saves makes Spotlight on SQL 
Servers price easier to justify. 

Spodight on SQL Servers only real 
weakness is its inability to send alerts via 
email or pager. Spotlight on SOL Server 
Enterprise edition, which I havent tested, 
provides this functionality, as well as historical 
trending capabilities. Better yet, the Enter- 
prise Edition of Spotlight on SQL Server can 
even be cheaper to license in many instances. 
Of course, buying this product can be dif- 
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SPOTLIGHT ON SQL SERVER 5.7 


PROS: Excellent real-time display of SQL Server 
activity and performance metrics; UI makes it 
easy to intuitively drill down into key subsystems 
for advanced diagnostics and monitoring 


CONS: Lacks the functionality to send email or 
pager alerts; doesn’t track historical trends; is a 
bit costly and can be difficult to purchase 


RATING: KKNK 
PRICE: Starts at $1495 


RECOMMENDATION: An excellent choice to 
save time and effort if you have many servers to 
monitor or a high volume of database activity. 


CONTACT: Quest Software e 949-754-8000 e 
http:/Avww.quest.com 


ficult because Quest requires you to call and 
speak directly with a sales person just to get a 
price quote. I wondered if some of the more 
complex monitoring functions that Spotlight 
on SQL Server provides could put enough 
load on an overloaded server to push it over 
the brink, but because the tool lets you 
specify which monitoring options you want 
to enable (and warns you when resource- 
intensive options are enabled), I think such 
concern might not be warranted. 

Overall, Spotlight on SQL Server is a 
great product that has a minimal learning 
curve and offers a great deal of functionality. 
Although its a bit expensive, there arent 
many other products with this functionality, 
and the insight the tool provides is extremely 
valuable. Spotlight on SQL Server is an indis- 
pensable resource if you have many servers 
to monitor or are in an environment with a 
lot of ad hoc activity. 500 
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Michael К. Campbell (hitp://sqladvice.com/ 
blogs) is a DBA and database developer with more than seven 
years of experience with SQL Server. 
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With the right resources 

at your fingertips, your 

day can be a lot smoother. 
That's where a Windows IT Pro 


VIP subscription comes in. 


Online access to 


we've ever published 


Plus, a one-year print subscription to your choice of Windows IT Pro or SQL Server Magazine 


No matter 

which hat you 

are wearing, 
Windows IT Pro 
VIP has you covered 


Windows IT Pro 

SQL Server Magazine 
Exchange & Outlook Pro VIP 
Security Pro VIP 

Scripting Pro VIP 


www.Wwindowsitpro.com/sub/vip WindowsITPro 


Got a great new product? 
Send announcements to products@sqlmag.com. 


New Products 


Blake Eno (products@windowsitpro.com) is product editor for Windows IT Pro and SQL Server Magazine. 


SECURITY 


ldera announced SQLsecure, a new security analysis solution for SQL Server 
implementations. The software identifies users who have inappropriate access rights 
and permissions, eliminates security holes and weaknesses, and monitors changes in 
access rights to ensure compliance. SQLsecure gathers a picture of your entire SQL 
Server environment and settings and provides tools for analysis and reporting. You 
can review and audit all SQL Server access controls, security-related properties, and 


integrated Windows security across computer, network, and Active Directory (AD) set- 


tings. SQLsecure costs 
$995 per SQL Server 
instance. For more in- 
formation, contact 
Idera at 713-533- 
5144, 877-464-3372, 
r http://www.idera 


.com. 


TECHNICAL 
RESOURCE 


ыыы 


PRI JUR 


SQL Server 
2005 
Integration Services 
Resource 


Sams Publishing released “Microsoft SQL 
Server 2005 Integration Services" by Kirk 
Haselden, development manager for Micro- 
softs SOL Server Integration Services (SSIS). 
The book 
provides 
real-world 
solutions to 
real-world 
problems. If 
youre new 
to SSIS, 
the begin- 
ning chap- 
ters include 
“Setting up 
Integration 
Services” 
and “Basics 


Wort Heselden 
d 


Microsoft: SOL Server 2005 


Integration Services 


SOL Server эз 


Sams Publishing Microsoft SQL 
Server 2005 Integration Services 


Idera SQLsecure 


and Concepts.” For more complex concepts, 
you can delve deeper in chapters such as 
“Control Flow Services" and “Management 
Services.’ The 744-page book costs $59.99; 
a downloadable Adobe Reader PDF version 
is available for $43.19. For more informa- 
tion, contact Sams Publishing at http:// 
wwwsamspublishing.com. 


REPORTING 


Migrate Crystal 
Reports to 
Reporting Services 


dataReference announced that 
Report Migrator works in con- 
junction with SQL Server 2005 
so that you can migrate Crystal 


the resulting reports through SQL Server 
2005 Reporting Services. With Report 
Migrator, you can continue to use Crystal 
Reports Designer to develop reports, but 
you can distribute the reports through 
Reporting Services. This functionality main- 
tains your investment in report design 
and gives you the flexibility to distribute 
reports across your organization without 
retraining your development staff. For more 
information, contact dataReference at 214- 
239-0820, 866-489-4512, or http://www 


.datareference.com. 


PERFORMANCE MONITORING 


Quest Releases .NET 
Application Management 
Solutions 


Quest Software announced two .NET 
application management solutions that help 
discover, diagnose, and resolve .NET appli- 
cation performance and availability prob- 
lems. Quest Management Pack for .NET 
works with Microsoft Operations Manager 
(MOM) 2005, and Foglight for .NET 
is part of Quests Application Advantage 
strategy for managing complex application 
environments and expands to monitor and 
manage .NET applications. Both solutions 
proactively monitor your applications and 
inform you of impending performance and 
availability problems. For more information, 
contact Quest Software at 949-754-8000 or 


http://www.quest.com. 


Reports output into Report 
Definition Language and run 


Quest Software Management Pack for .NET 
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DEVELOPMENT 


Manage .NET Application 
life Cycle 


Lallix announced Lattix LDM for .NET, a 
tool that uses the Lightweight Dependency 
Model approach to analyzing the architecture 
of your .NET applications. Lattix LDM for 
.NET lets you analyze .NET application 
architecture in detail, edit the structure to 
create test scenarios, and specify design rules 
to formalize and communicate the design 
structure to others. The tool provides a high- 
level view of your architecture and lets you 
drill down to a subsystem and examine code 
associated with its dependencies. The product 
can also remove unwanted dependencies and 
rename subsystems. Latix LDM for .NET 
starts at $495 for the Professional Edition. 
For more information, contact Lattix at 


978-474-5022 or http://www.lattix.com, 


DATABASE MANAGEMENT 


Visualize What's Happening 
Within Your Database and 
SOL Code 


Killer Bite Software announced SQL Visu- 
alizer,a Windows client-based database query 
and management tool that lets you navigate 
around your database objects and visualize 
whats happening within your database and 
SQL code.The software searches for database 
objects and content across multiple databases 
and servers and is able to override server 
connections properties at the database level. 
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Laltix LDM for .NET 


You can also view the history of previously 
executed queries, which are maintained 
between sessions. SQL Visualizer features 
IntelliSense, custom object scripting, data 
scripting, code snippets, and code regions. 
SOL Visualizer is a free download. For more 
information, contact Killer Bite Software at 


http://wwwsqlvisualizer.com. 


BUSINESS INTELLIGENCE 


Integrated BI Solution for 
SOL Server 2005 and 2000 


XMLA Consulting announced ReportPortal 
2.1, an integrated business intelligence (BI) 
solution that provides 


Doere Me ronal d nme Pp 


== 
ReportPortal 


XMLA Consulting ReportPortal 2.1 
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analysis, reporting, and 
advanced data visualiza- 
tion features for SQL 
Server 2005 and 2000. 
ReportPortal is a client 
application for Micro- 
soft SOL Server 2000 
Analysis Services that 
lets you build, publish, 
and view a variety of 
reports, including OLAP, 
data-mining, and SQL 
Server 2005 Reporting 
Services reports. The 


latest release includes a tree map and pie- 
chart tree, bar-chart tree, geographical map 
chart, and dashboard reports. For more 
information, contact XMLA Consulting at 
813-866-3483 or http://www.reportportal 


.com. 


DATABASE COMPARISON 


Compare and Synchronize 
Databases and Schema 


TulaSoft announced SQL Examiner 1.5 
and SQL Data Examiner 1.1, which com- 
pare and synchronize SQL Server data- 
base schemas and SQL Server databases, 
respectively. SQL Examiner compares 
the schema of two SQL Server databases 
and locates the changes in tables, views, 
stored procedures, and any other object in the 
database. When you use SQL Examiner with 
SQL Data Examiner, you can also compare 
and synchronize data differences between the 
two databases. And now, SQL Examiner can 
compare and synchronize Common Language 
Runtime (CLR) objects that SQL Server 2005 
supports. Pricing for SQL Examiner and SQL 
Data Examiner starts at $199.95. For more 
information, contact TulaSoft at http://www 


-Sglaccessories.com. [SQL | 
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Insights from the SQL Server industry 


Industry 
Briefings 


Patch, Provision, Replicate, 
Керегі... Don’t You Have 
Better Things to Do? 

If you're the type of database administrator 
who yearns to manually patch many hetero- 
geneous databases and genuinely takes plea- 
sure in performing routine tasks that you 
know ought to be standardized and auto- 
mated, then GridApp Systems’ (http:// 
www.gridapp.com) Clarity 3.2 product line 
is probably not a fit for you. If, however, 
you're among the growing number of DBAs 
who, as Matthew Zito, Chief Scientist for 
GridApp Systems, cites, spends “85 percent 
of the workday on routine administrative 
tasks like patching, replication, and. provi- 
sioning;' then you might just find Clarity 
products of interest. 

In an industry where solutions to 
manage high-value tasks such as perfor- 
mance tuning and database design are the 
norm, the Clarity product line seeks to 
reduce the time DBAs spend on lower- 
level manual tasks by providing automated 
provisioning, patching, cluster management, 
and validation, thus freeing up time and 
increasing productivity. The Clarity product 
line can automate and standardize database 
policy and function from one pane, whether 
the database is SQL Server, Oracle, IBM, or 
another platform. 

Clarity also makes compliance regula- 
tions easier to follow. "When we talk to 
clients, they say ther DBAs are terrified 
by Microsoft or Oracle database audits,” 
said Zito. He went on to explain that most 
DBAs have only a vague idea which data- 
bases need patches at a given time. “Before 
Clarity, the standard in compliance was 
an eighty-page Word document released 
by the auditors that the DBAs cut up and 
handed out to different departments.” With 
Clarity, default standards are created by the 
administrator and then automatically applied 
to every database in the organization. A 
reporting trail is created so that a DBA can 
see what's missing and what needs imme- 
diate attention. 

—Sam Davenport 


_.com) recently announced a major upgrade to its 


Cache’s Jalepeno Technology 
Eliminates Object-Relational 
Mapping: Es Muy Caliente 
InterSystems Corporation (http://www. intersystems_ 


flagship database product: Caché, a multidimensional 
database that uniquely combines robust objects and 

robust SQL. The upgrade includes innovative technologies 
for rapid Web application development that can enhance productivity in shops that rely 
on Web-application business. According to Paul Grabscheid, InterSystems vice president of 
strategic planning, the new release includes an extensible, high-level development frame- 
work called Zen, which is “our implementation of the Asynchronous JavaScript and XML 
(AJAX) concept for building rich, dynamic applications that run in browsers.” Based on 
XML, Zen uses the language to define pages but eliminates runtime parsing and compila- 
tion. Because the XML is precompiled, developers can deliver pages faster. 

The new release of Caché also includes a new software component, Jalepetio (Ауа 
LAnguage PErsistence with NO mapping), which gives developers a way to persist Java 
objects while eliminating the need for relational mapping. According to Grabscheid, 
two things motivate customers to move to Caché: “One, they're developing something 
new and they like the object capabilities we provide, and two, they're facing a serious 
scalability problem and they see that our solution gives them much better performance" 
Applications created with the InterSystems framework can access the Caché database 
platform or major relational database platforms including SQL Server, Oracle, and 


Sybase, or multiple platforms in a heterogeneous environment. 


Offering Grealer Value 

for the Data Center 

According to Patrick Rogers, vice presi- 
dent of Products and Partners at Network 
Appliance (http://www.netapp.com), the 
core requirements of the companys SOL 
Server-based customers revolve around 
enhancing the value of the data center. 
Customers want to cut storage costs and 
increase utilization, limit the time required 
for storage administration, and enhance 
data-center performance. To help address 
these core needs, NetApp offers professional 
services and software products designed to 
make а SQL Server database professionals 
job easier. 

For example, companies that are growing 
rapidly or that have a business need to make 


SQL Server Magazine 


—Dawn Cyr 


better use of existing data might want to 
take advantage of snapshot technology in 
their development and test environments, 
or on the back end of decision-support 
applications. But quickly deploying multiple 
snapshots of a database is complex—the 
deployment can take hours or days, and the 
storage requirements for such deployments 
can be high. NetApp’s FlexClone product 
lets you instantly replicate data volumes and 
data sets without requiring extra storage. And 
the company’s SnapManager for SQL Server 
lets you keep a close eye on all those new 
instances. Even if you might not have a lot of 
money to throw at extra storage, you can still 
make the most of the storage you have. Б 

—Dawn Cyr 
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G0 Visual Studio 


o Layered framework engineered for .NET 2.0 
o Strong typed business objects 
with drag-n-drop 
o Automated parent-child 
relationship management 
© Innovative user interface binding 
o Integrated localization and translation tools 


© Natively supports SQL Server, Oracle, FoxPro, 
Access, and OLE DB 


© Intuitive migration from VB6, FoxPro, Access 
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Replication 


istributing data between different locations in an organization is essential for scalability, 
availability, and distributed reporting. SQL Server 2005 uses a publishing model to 


describe its distribution process: The data being replicated is the article, the system that’s the 
source of the data is the Publisher, and the systems that receive the replicated data are the 
Subscribers. The SQL Server system that transfers the data is the Distributor. One Publisher 
can have multiple Subscribers, and in many cases, the Publisher also acts as the Distributor. 


SQL Server 2005 supports several types of database replication to meet different needs. 


Snapshot Replication 

With snapshot replication, the most basic 
form of replication, the Publisher makes a 
point-in-time copy of the data for distribu- 
tion to the Subscribers. Snapshot replication 
is best suited for distributed reporting sce- 
narios in which Subscribers might have high- 
latency connections and don’t need access to 
immediate data updates. In addition, SQL 
Server 2005 snapshot replication 1s supported 
for many ODBC- and OLE DB-comphant 
heterogeneous databases. 


Transactional Replication 
At the other end of the replication spectrum, 
transactional replication helps Subscribers 


stay current with the most recent changes 
from the Publisher. The Publisher sends a 


T OPENED A DANCE CLUB 
THAT'S SO EXCLUSIVE 


IN. 


® By Scott Adams 
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snapshot to the Subscribers to synchronize 
data. After the Publisher and Subscriber data- 
bases are in synch, data from the Publisher's 
transaction log is captured and distributed 
to the Subscribers. Transactional replica- 
tion is suited for scenarios in which good 
connectivity exists between Publishers and 
Subscribers and in which Subscribers need 
low data latency. 


“Transactional Replication with 
Updating Subscriptions 

Although transactional replication is great 

for keeping multiple Subscribers updated, 

it’s also a one-way technology—Subscribers 

cant change the data that flows from the 

Publisher. To address this problem, Updating 
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Subscriptions lets Subscribers update repli- 
cated data and push those updates back to 
the Publisher. 


- Merge Replication 

Merge replication is designed for branch 
offices in which Publishers and Subscribers 
might not always be connected and data 
might be updated at more than one location. 
The Publisher sends a database snapshot to 
the Subscribers. A merge agent at the Pub- 
lisher periodically captures data changes and 
forwards those changes to the Distributor, 
which sends the changes to the Subscribers. 
A built-in conflict-resolution engine arbi- 
trates situations in which multiple servers are 
updating the same data. 


Peer-to-Peer Transactional 
Replication 
Peer-to-peer transactional replication was 
introduced with SQL Server 2005 and is 
designed to facilitate scalability by spreading 
data across multiple server systems. Peer-to- 
peer doesnt use the hierarchical publishing 
model. Instead, all SQL Server systems 
communicate directly. Each node acts as a 
Publisher and Subscriber, sharing the same 
schema and data. 500 
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manage, administer and control your SOL Server enterprise. Monitor database 


performance in real-time. Kill locks, blocks, freezes and stops with a flick of your 
wrist. Backup databases faster than a speeding bullet. Master the forces of auditing www.id era.com 
and compliance. Scale and roll-out new applications with ease. Whatever your 


challenge, Idera's products are battle-proven, easy-to-use, and are guaranteed 
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installed in minutes, configured in hours, and deployed worldwide in days. 
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